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Abstract. In this paper we study the zero-sum and nonzero-sum differential games with not 
assuming Isaacs condition. Along with the partition vr of the time interval [0, T], we choose the 
suitable random non-anticipative strategy with delay to study our differential games with asymmet¬ 
ric information. Using Fenchel transformation, we prove that the limits of the upper value function 
and lower value function coincide when the mesh of partition vr tends to 0. Moreover, 
we give a characterization for the Nash equilibrium payoff (NEP, for short) of our nonzero-sum 
differential games without Isaacs condition, then we prove the existence of the NEP of our games. 
Einally, by considering all the strategies along with all partitions, we give a new characterization 
for the value of our zero-sum differential game with asymmetric information under some equivalent 
Isaacs condition. 

Keywords. Zero-sum and nonzero-sum differential game, asymmetric information, Isaacs condi¬ 
tion, Nash equilibrium payoffs, Eenchel transformation. 


1 Introduction 

Zero-sum stochastic differential games have developed rapidly since the pioneering work m by 
Eleming and Souganidis after they firstly introduced the Isaacs condition and characterized the 
value of these games as a viscosity solution of some Hamilton-Jacobi-Isaacs equation. Hamadene 
and Lepeltier in [9] characterized the value of zero-sum stochastic differential game as a solution 
of some backward stochastic differential equation (BSDE, for short) under the equivalent Isaacs 
condition. Cardaliaguet in [5] studied the zero-sum differential game with asymmetric information 
under the Isaacs condition and characterized the value of this game as a dual solution of some 
Hamilton-Jacobi equation. 

On the other hand, nonzero-sum differential games with Isaacs condition have been studied 
by many authors. When playing “control against control”, Hamadene, Lepeltier and Peng in 
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m characterized the Nash equilibrium point for nonzero-sum stochastic differential games as the 
solution of some BSDE. Then Buckdahn, Cardaliaguet and Rainer in [T] gave a new definition of 
Nash equilibrium payoffs (NEP, for short) and characterized this NEP, then they obtained the NEP 
through a approximated method with playing “strategy against strategy”. Rainer in |12] compared 
the two approaches used in [T] and |10] for nonzero-sum stochastic differential game and obtained 
that the two definitions of Nash equilibrium payoffs coincide when they both exist. Lin in m 
generalized the result of [I] into the case with the nonlinear payoffs. 

Recently, some authors (such as, Buckdahn, Li, Quincampoix, etc., in [3], [4] and m) tried to 
investigate the zero-sum stochastic differential games without the Isaacs condition. In [3] and [3], 
the authors considered the zero-sum differential games and zero-sum stochastic differential games, 
respectively, with symmetric information and without Isaacs condition by using a suitable notion 
of mixed strategies and proved the existence of the value of these games. Buckdahn, Quincampoix, 
Rainer and Xu in [6] generalized the case without Isaacs condition into the zero-sum differential 
games with asymmetric information. All these papers m, 0 and m used the strategy along 
the partition tt of the time interval [0, T] and showed that the upper and lower value function 
, V" defined along the partition vr coincide as the mesh of tt tends to 0. Although they have 
proved the upper and lower value function converge to the same function U when |7r| (the 

mesh of vr) tends to 0, one may want to know the characterization for this value U. For this, we 
try to give a characterization for the value U in Section 5. Inspired by the above papers without 
Isaacs condition, we want to study the NEP for the non-zero sum differential games without Isaacs 
condition in Section 4. 

More details, we consider the following dynamics: 

Xs = x + J^ f{Xr,Ur,Vr)dr, s€[t,T], (1.1) 

where u and v are stochastic processes taking value in compact U and V, respectively, / : M” x 
U xV ^ M”" is bounded, Lipschitz in x, uniformly in {u,v). For any fixed partition vr of time 
interval [0,T], we give a generalized deflation of non-anticipative strategy with delay along this 
partition tt (see, Def. 12.ip which has the property that: for any partitions tti and 7r2 with“7ri C 7r2” 
(the partition points of 7r2 contain all of the partition points of tti), it holds the strategy set 
A^^{t,T) C for Player I; similarly, we have that for Player 11. Along with the partition 

TT, we define the upper and lower value functions W^{t,x,p,q) and V^{t,x,p,q) (more details see 
Section 2) for our zero-sum differential game with asymmetric. 

In Section 3, we firstly show that the upper and lower value function and V" defined by 
the strategy from A^{t,T) and are just the upper and lower value function Wi and Vi 

defined by the strategy from Ai{t,T) and which is the subset of A^{t,T) and B^{t,T), 

respectively. Then, with the help of Fenchel transform, we prove a sub-dynamic programming 
principle (sub-DPP, for short) for the conjugate functions of and then we show that 
and converge to the same function U as the mesh of tt tends to 0 without Isaacs condition. 
Moreover, this value U can be characterized as the unique dual viscosity solution of the following 
Hamilton-Jacobi-Isaacs equation 

r ^(t,x)+i?(x,DR(Lx)) =0, (t,x)G[0,r] xM", 

1 = Y.i,jPiQj9ijix), {p,q) G A(/) x A(J), ’ 

where H{xA) = inf^eP(f/) sup^gp(y) {f{x,u,v)p{du)u{dv) A)- 

In Section 4, we mainly consider the nonzero-sum differential game with symmetric information 
(i.e., I = J = 1) and without Isaac condition. Inspired by the definition of NEP used in [T], we 
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introduce a new definition of NEP for our nonzero-sum differential games. Using the value function 
U that we find in Section 3, we show a characterization for our NEP. Furthermore, we prove the 
existence of the NEP for our nonzero-sum differential games without Isaacs condition using this 
characterization. 

In Section 5, we give a characterization for the value function U (found in Section 3) of our zero- 
sum differential games with asymmetric information. With the property that T) C T) 

if “tti C 7r2”, we can consider the strategies in A{t,T) where A{t,T) is the union of the A^{t,T) 
with all the partitions vr for Player I, similarly that for Player II. Then we show that the upper 
and lower value function W{t, x,p, q), V{t, x,p, q) defined by the strategies from A{t, T) and B{t, T) 
coincide with the value function U{t, x, p, q) which is the unique dual viscosity solution of Hamilton- 
Jacobi-Isaac equation (jl.2p under some equivalent Isaacs condition. Therefore, we also provide a 
new numerical method for calculating the value of the zero-sum differential game with asymmetric 
information. At last, we give an example to illustrate that the equivalent Isaacs condition is 
necessary. 

Our paper is organized as follows. In Section 2 we give some introduction about the dynamic 
and the strategies for our games. Section 3 is devoted to proving the existence of the value of our 
zero-sum differential game with asymmetric information and without Isaacs condition. In Section 
4 we prove the existence of the Nash equilibrium payoffs of our nonzero-sum differential game with 
symmetric information and without Isaacs condition. Finally, we give a characterization for the 
value of the zero-sum differential games under some equivalent Isaacs condition in Section 5. 


2 Preliminaries 


Let (n, T", P) be the canonical Wiener space, that is, P is the set of continuous functions from [0, T] 
to P is the completed ci-algebra on P, P is the Wiener measure. We define the canonical process 
Bt{u}) = t E [0,T], u = {uji,uj2) E P. Then S is a 2-dimensional 

Brownian motion on (P,J-', P) and B^ is independent of B^. We denote by > t} the 

filtration generated by the Brownian motion B, where Pt,s = (^{Br — Bt, r E [t, s]} V M, Af is the 
set of null-set of P. 


For any given partition tt = {0 = to < ti < ■ ■ ■ < tj\f = T} of the interval [0, T], we define random 
variables Qj = i = 1,2, j = where 4>o,i(x) = 

a: E M. Obviously, {Cij}i<j<N, * = 1,2, is a family of independent random variables with uniform 
distribution on [0,1]. Let U and V be the compact metric spaces which are the control state 
spaces used by Player I and II, respectively. Let P{U) and P{V) be the space of all probability 
measures over U and V, respectively. From Skorohod’s Representation Theorem, V{U) (resp., 
Viy)) coincides with the set of the distributions of all [/-valued (resp., U-valued) random variables. 
Now we introduce the admissible controls for both players. 


For any t E [0, T], the [/-valued and Lebesgue measurable functions (us)sg[t,r] form the set of 
admissible controls for Player I, the U-valued and Lebesgue measurable functions (u 5 ) 5 g[j 7 ^] that 
for Player 11. We denote by Ut^T the set of admissible controls (us)se[t,r] lor Player I and by Vt^T 
the set of admissible controls (us)sg[t,r] lor Player 11. 

For any given / E [0,T], x E we consider the following ordinary differential equation 


Xg = X + J f{Xr,Ur,Vr)dr, sE[t, T], 


( 2 . 1 ) 
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where u E Ut;T and v E and the coefficient / : M”" x U x V M” is supposed to be bounded, 

continuous with respect to {u, v) and Lipschitz continuous in x, uniformly with respect to u and 
V. Therefore, equation (|2.in has a unique solution and we denote it by From standard 

estimates we obtain that there exists a constant C > 0 such that, for all {t, x), {t', x') E [0, T] x R”, 
for all s E [t V t', T], 

(1) -x| < C(s-t), 

(2 2 ) 

(2) < C{\t - t'\ + lx - x'l). 


The cost functionals of the zero-sum differential games are defined by the I x J functionals 
i = 1,2,...,/, j = 1,2,...,J, where the mappings gij ; R”' R are Lipschitz 
continuous and bounded. Player I wants to minimize i.e., it is a cost functional for 

him/her, while Player II wants to maximize gij{x!^^’'^’^) a payoff for him/her. The cost functionals 
of nonzero-sum differential games are defined in Section 5. 

The rules for our zero-sum differential game with asymmetric information are as follows: 

(1) At the beginning of the game, a pair (f,j) is chosen randomly with the probability {p,q) E 
A(I) X A(J), where A(/) is the set of probabilities p = {pi)i=i,...j on {!,...,/} and Yli=iPi — 
A(J) is defined similarly. Both players know the probability {p,q). 

(2) The choice of i is only communicated with Player I, while the choice of j is only communicated 
with Player II. But both players observe their opponent’s controls. 

Generally speaking, differential games with “control against control” don’t admit a dynamic 
programming principle and the value does, in general, not exist. Thus, we study the game of the 
type “nonanticipative strategy with delay against nonanticipative strategy with delay”. Considering 
the asymmetry of the information, the players want to hide a part of their private information. For 
this they randomize their strategies, and the kind of randomization we choose is the key to obtain 
a value for our zero-sum game in a framework without Isaacs condition. 

Let we consider an arbitrarily given partition tt = {0 = < ti < ... < = T} and assume 

t E We give the definition of random non-anticipative strategies with delay for a game 

over the time interval [t,T]. 

Definition 2.1. A random non-anticipative strategy with delay (NAD, for short) along the partition 
TT for Player I is a mapping a : II x [t,T] x Vt,T of the form 

N 

a{u},v){s) = akiuj,Clk-iioj),v){s)Iit,tk)is) ^ az(a;, (CLi> • ■ ■ > 0 - 2 : Cm-i)(w), n)(s)/[t,_j,t^)(s), 

l=k^l 


where Q = {Ch, Cffi), k — 1<1<N — 2, and for k < I < N, the ai : D x R^(^ x [t V t/_i, b] x 
Vt,T Ut^T, are Fq F-2 ® ^(R 2 (i fc)+ij (g) Y ti_i,ti]) (g) B{Vt,T)-measurable functions satisfying: 
For all v,v' E Vt,T, it holds that, whenever v = v' a.e. on [t,ti-i], we have for all uj £ Q, for all 
X E x, v){s) = ai{uj, x, v'){s), a.e. on [t V tz_i, b], A: -|- 1 < ^ < A^. 

Similarly, a random NAD strategy along the partition vr for Player II is a mapping /3 : H x 
[t,T] X Ut^T ^ Vt,T of the form 


N 

E 


I3{u:,u){s) = l3k{u:,Clk-ii^)N){s)I[t,tDis) + (C-i> • • • > Cz- 2 > C 2 ,z-i)(w), 


where Q = (Cf;, CJfi)’ A; — l<(<iV — 2, and for k < I < N , the (3i : D x R^^^ x [t V x 

hlt,T are FQ^tk -2 ® (g) B{[t V t/_i, b]) (g) BiUt^r)-measurable functions satisfying: 
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For all u,u' G it holds that, whenever u = u' a.e. on [t,ti-i], we have for all uj £ Q, for all 
X G Pilio, X, u){s) = /3i{io, X, u'){s), a.e. on [t V ti-i,ti], k + 1 < I < N. 


The set of all such random NAD strategies for Player I along the partition tt is denoted by 
A^it, T), and similarly B'^{t, T) is that for Player II, ^o{t, T) are the sets of pure (i.e. 

deterministic) strategies for player I and II. Then, we know for any partitions tt, tt' of interval [t, T] 
with TT C tt', it holds A'^{t,T) C A^'{t,T). Moreover we define 

A{t,T) := lJ^-(t,T), B{t,T) := \jB^{t,T). (2.3) 


Definition 2.2. ITe say that a G Af {t, T), if the mapping a : kt x [t,T] x Vt,T hlt,T has the form 

N 

a{ui,v){s) = afc(Cr,fc-i(w),n)(s)/[t,i^)(s) + ^ a/((Cfc-i> ■ ■ ■ > Cr- 2 > Cm-i)(w), u)(s)/[t^_j,i,)(s), 

l=k+l 


where Q = k — 1<1<N — 2, and for k < I < N, the ai : x [t V x 

Vt,T I—^ Idt^T, are (8i B{[t V ti-i,ti]) (8) B{Vt,T)-'measurable functions satisfying: For 

all v,v' G Vt,T, it holds that, whenever v = v' a.e. on [f, we have for all x G 
ai{x,v){s) = ai{x,v'){s), a.e. on [tV ti-i,ti], k + l<l<N. Similarly, we have /3 £ Bf{t,T). 


Obviously, from the Definition 12. II and 12.21 we know ^g(t,T) C Af{t,T) C A^{t,T), BQ{t,T) C 
B[(t,T) C B^{t,T). 

From the definition of a NAD strategy, we get the following lemma which is crucial throughout 
the paper. Such a result was established the first time by Buckdahn, Cardaliaguet and Rainer [T], 
Lemma 2.4. 


Lemma 2.1. For any a £ A{t,T) and {3 £ B{t,T), there exists a unique measurable mapping 
kt 3 LO {u^,Vu)) £ Ut^T X Vt,T, sueh that, for all ui £ kl, 

a{u:,Vuj) = u^, /3{uj,Ui^) = Voj, a.e. on [t,T]. 


A proof of Lemma l2.II for a similar context can be found in [6]. However, since our framework 
is slightly more general, for the reader’s convenience we prefer to give it here. 


Proof. For any a £ A{t,T), from (|2.3p we know there exist a partition tti of interval [0,T], such 
that a £ A^^{t,T). Similarly, there exist a partition tt 2 of interval [0,r], such that ft £ B'^^{t,T). 
Define tt = tti U 7r2 which combines vri and 7r2, and notice that then a £ A^{t, T), and ft £ B^{t, T). 

Indeed, if, for example, tt = {0 = to < H < ••• < t]\f = T} and t/_i,t;+i G tti , but 

B* -Bf 

ti ^ TTi, then for [t;_i, t;_|_i] as j-th subinterval of the partition tti, (fj = <Lo^i(- ^^ ^ ) = 


T is a mea- 


surable function of {CiiXii+i)^ i = 1,2. The above situation can be extended into an obvious manner 
to the general case tti C vr and allows to show that A^^{t,T) C A^{t,T). 


Assume vr = {0 = to < ti < • • • < tAr = T}, and t G [tk-i,tk), 0 < k < N. For each w G D, 
a{uj,v) (respectively, ft{u},u)) restricted to [t, t^] depends only on u G Vt,T (respectively, u £ Ut^r) 
restricted to [t, tfc_i]. Since [t, tfc_i] is empty or a singleton, from the property of delay we know 
a{ui,v), ft{io,u) restricted to [t,tfc] do not depend on v and u. Then we can define ul, = a{io,v^), 
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vIj = j3{uj,vP), for any G Vt^T and G Ut^T, and the mapping 0, 3 to iulj,v^) G Ut^T x Vt,T is 
measurable. Then we have 

a{oj^v^) = I3{uj,u^) = a.e. on [t,tk]- 

Now we assume that for j > 2, a(a;,ui~^) = a.e. on [t,tj^k- 2 ]^ and 

(jj t-3 {uir ^is measurable. 

Then we define ut = a{io,vij~^), vt = Obviously, uh = uiT^, vt = vIt^, a.e. 

on [t,tj+k- 2 ]- From the property of delay, we have a{u!,vij) = a(a;,u£~^) = ut, f3{uj,uij) = 
/3{uj,uir^) = Vuj, a.e. on and u t-3 is measurable. Consequently, we get the 

existence of the measurable mapping n 9 w G Ut^T x Vt,T satisfying this lemma and the 

uniqueness is obvious from the above construction. □ 


Remark 2.1. This lemma implies that, for any partition tt of [0,T]; 

For any a G A^{t,T), (3 G B'^{t,T), but also for any a G A{t,T), (3 G B'^{t,T), and for any 
a G A^{t,T), j3 G B{t,T), there exists the unique mapping Q, 3 u {Ui^iVuf) G Ut^T x Vt,T, such 
that for all uj ^ Q, 

a{u},Vuj) = Uui, /3{uj,Ucj) = Vuj, a.e. on [t,T]. 


Remark 2.2. 

following form: 

/ 

u{u}, s) 

< 

v{u}, s) 


The control processes u and v along the partition vr satisfying Lemma \2.1\ have the 


N 

= ■ /[i,4)(s) + E • ,cr_2>cr,z_i’^) • 

l=k+l 

N 

= cik-vs) • cEi> • • • > cr-2,C2,i-vs) • 


where u\v^ are ^'^~^^)®B{[t\/ti-i,ti\)-measurahle functions, k < I < N. We denoted 

by Ufrp and Vfrp the set of the processes u and v, respectively, which have the above forms. The 
corresponding controls set constructed by Ai{t,T) and Bf{t,T) we denoted byU^!^ and The 

only difference between Ufj, and is that, if u ^ ^tT’ ui, k < I < N is just (g) 

B{[t\/ ti_i,ti])-measurable. 

Remark 2.3. ITe write a G {A^ {t,T)Y, if a = (ai,...,a/) and a* G A^{t,T), i = 

and j3 G {B'^ {t,T)y, if j3 = {fi,..., jdj) and /3j G B'^{t,T), j = 1,...,J. Similarly, we have 

a G {A{t,T)y, P € {B{t,T)y. 

Let {p,q) G A(I) x A(J), {t,x) G [0,T] x M”', tt = {0 = to < ti <...< t]\f = T} and 
t G [tk-i,tk), we define the payoff functionals 


/ J 

J{t,x,a,yp,q) = 

i=l j=l 


Now we define the following upper value functions and lower value functions, respectively, 


W'^{t,x,p, q) 
V^{t,x,p, q) 
W{t,x,p,q) 
V{t,x,p, q) 


inf sup J{t,x, 01 , (3, p,q), (2-4) 

sup inf J{t,x,a,j3,p,q), (2-5) 

oGiA-^yT))! 

inf sup J{t,x,a, I3,p,q), (2-6) 

a&(A(t,T)y 

sup inf J{t,x,a, I3,p,q). (2-7) 

g&{B{t,T)y ae{A(t,T)y 
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Definition 2.3. Let e > 0, we say that a G {A'^{t,T))^ is an s-optimal randomized strategy for 
W'^{t, x,p, q), if for all {t, x,p, q) G [0, T] x M"" x A(/) x A( J), it holds 

\W^{t,x,p,q) - sup J{t,x,a,P,p,q)\ < e. (2.8) 

he{B^(t,T)y 

We say that jd G {B'^{t,T)Y is an £-optimal randomized strategy for V'^{t,x,p,q), if for all 
{t,x,p,q) G [0,T] X R"' x A(/) x A(J), it holds 

\V'^{t,x,p,q) - inf J(t, x, d,/3,p, g)| < e. (2.9) 

a&{A^it,T)y 

Similarly, we define s-optimal strategies for the other upper and lower value functions. 

3 The functions W'"{t,x,p,q) and V'"{t,x,p,q) without Isaacs condition 

In this section we mainly prove that when the mesh of the partition vr tends to 0, the functions 
and converge uniformly to the same function which is the unique dual solution of some 
Hamilton-Jacobi-Isaacs (HJI, for short) equation. For this, we introduce the following functions: 

Wf{t,x,p,q) = _ inf sup J{t,x,a,Yp,q), (3.1) 

aeiAf {t,T)Y g^{js^{t^T)y 

Vi{t,x,p,q) = sup inf J{t,x,a,Yp,q)- (3.2) 

$e{Byt,T)y «e(.A5^(t,r)).f 

Theorem 3.1. For any {t,x,p, q) G [0,T] xR"- x A(/) x A(J), it holds V'^{t, x,p, q) = Vyit, x,p, q), 
W'^{t,x,p,q) = Wf{t,x,p,q). 

We only give the proof for V^{t, x,p, q) = Vf (t, x,p, q), the proof for W'^{t, x,p, q) = Wf{t, x,p, q) 
is similar. In order to show that, we need the following auxiliary lower value function; 

/ ./ 

V^{t,x,p,q)= esssup _ essinf y^y^^piqjE[gij{xY’°‘^’^')\^o,tk- 2 ]- (3.3) 

gyB^ (t,T)y yT)y 

Lemma 3.1. For all {t,x,p,q) G [0, T] x R” x A(/) x A( J), the function V^{t,x,p,q) is determin¬ 
istic, i.e., independent of F'o^tk- 2 ’ Ihen we have V^{t,x,p,q) = E[V^{t,x,p,q)], P-a.s. 

Proof. For Q = ^([O, T]; R^), we assume 

if = {/i G n : 3 Radon-Nikodym derivative h G iy^([0, T]; R^),/i,(s) = h{s A tk- 2 ),s G [0,r]}, then 
we know H is the Cameron-Martin space. For any h £ F[, we define the mapping r/^ : i—)■ 12 by 
Th{u;) := cj + /i, cj G 12. Then, we know tu is a bijection and rff = T-h- 
For any a G A.'^{t, T), we know a has the form of 

N 

aiu!,v){s) = akiuj,Clk-iY),v)is)I[t,tk)Y) + 0!iiuJ,iCk-i, ■ ■ ■ ,C[- 2 ,Ci,i-i)Y),v)is)I[ti_uti)Y)- 

l=k+l 

Then, for any h £ FI, we define 
a^(w, u)(s) 

N 

:= ak{Th{uj),Clk-iY)y)is)I[t,ty{s) + aiYhY), (CLi> • • ■ X[-2Xli-i)Y),v)is)I[ti-uti)(^^- 

l=k+l 
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Obviously, we know E A^{t,T), and the mapping a is a bijection on A^{t,T). For any 

h & H, 13 & is similarly defined and /3 is a bijection on Then we get 


or, = P-a.s. 


(3.4) 


I J 


We now define I{t,x,p,q,/3) := essinf X) Z) ^ 

&e{A-^{t,T)y i=ij=i 


I J 


Since I{t,x,p,q, j3) < Z Z Pi<ijE[gij{x!f’°''”^y\FQ^tk- 2 ]^ P-a.s., from ([33]) we get 
i=lj=l 


I J 


I{t,x,p,q,y) o Th 

i=l j=l 


(3.5) 


On the other hand, for any random variable such that C < Z Z PiQj^idiji^T ’ * ’ ^ )l-^o,tfc_ 2 ]! 

i=lj=l 

I J i . R- 

P-a.s., we have that ^ o t_, < Z Z PiQj^idiji^T^’^’^’ ^)l-^o,tfe_ 2 ]) T’-a.s., for all a E A'^{t,T), then 

i=lj=l 

we know ^ o t_, < I{t, x,p, q, $), P-a.s., which means that ^ < I{t, x,p, q, (3) o r,. Thus we have 

/ ,7 

Using the similar method, we obtain 


I{t,x,p,q,l3)oTh= essini ^^piqjE[gij{Xj, ’ *’ ' )|J^o,tfc_ 2 ], ^-a-s. 

rv(^( A'^(+ TlV 

2 = 1 j = l 


(3.6) 


( esssup I{t,x,p,q,$)joTh= esssup (l{t,x,p,q, (3) o Th), P-as. 
Therefore, for all h & H, from (13.7p and (13.6p we get, P-a.s., 


(3.7) 


V{t,x,p,q)oTh= { esssup I{t,x,p,q, f3)j o th 

I J t ^ 13^ 

= esssup essinf ^ ^ PiqjE[gij (x/’“' ’ ^)|^' 0 , 4 - 2 ] 


P&{B^{t,T)y 


(3.8) 


/ J 


= esssup 




Then combined with Lemma 4.1 in [2], we obtain our desired results. 
Now we give the proof of Theorem 13.11 


□ 


Proof. Step 1: We prove V'^ft, x,p, q) = Vy{t, x,p, q), for all {t, x,p, q) E [0,T] x M"' x A(/) x A(J). 
For any /3 E {Bf{t,T)y (independent of Ptk- 2 )i ''^e have 


/ J 


V^{t,x,p,q)> essinf V J'o,tfc_ 2 ]; ^-a-s. 


For any e > 0, there exists a G {A'^{t,T)y (depending on e, /3), snch that 

/ ,7 

V^t,x,p,q) > - e, P-a.s. (3.9) 

i=i j=i 

From Lemma l3.II and (I3.9|] . we have 


I J 


V^{t,x,p,q) = E[V^{t,x,p,q)] > ^ - e 

i=l j=l 

I J 


(3.10) 


A,^^ 'TWI EE PiqjE[gij{X, 


t,x,ai,(3j 


— e. 




Since ()3.10p holds for any /3 G , we get 

I ,7 


V'^{t,x,p,q) > snp _ inf y2'^Pi^j^l9ij{^'f'‘^"'^')]-^ = Vy{t,x,p,q)-e. (3.11) 

P&(Bl(t,T)y °-AAl {t,T)) 


From the arbitrariness of e, we obtain V^{t,x,p,q) > Vy{t,x,p,q). 

On the other hand, for any e > 0, there exists /3 G {t,T))'^, such that, P-a.s., 

I J 

V'^{t,x,p,q) < essinf V ^ 

I J 

- ~ ^ ^ PiQj^idij ) I^' 0 , 4 - 2 ] + ^• 


(3.12) 


Notice that Fi[(7jj(X.^^’“*’^'’)|J'o,4_2](‘^) = B[gij{Xr^ ’ )], P{duj)-a.s., where u}{s) = a;(s At^j), 

s G [0,T]. Thus, from (j3.12p we have 

7 ,7 


V'^{t,x,p,q) < essinf '^'^piqjE[gij{x!y'’‘^"’^^ )] + i 
ae(yir(t,r)F^^ 


I J 


(3.13) 


y,x,aiy^ 


< esssup essinf PiqiE[gij{Xr^ ’ '’’^^ )] + £ = Vy{t,x,p,q) + e. 

mi3i{t,T)y &yAyt,T)y 


From the arbitrariness of e, we obtain V^{t,x,p,q) < Vf {t,x,p,q). 

Step 2: We prove V'^{t,x,p,q) = V'^{t,x,p,q), for all {t,x,p,q) G [0,T] x R"- x A(/) x A(J). 
For any e > 0, there exists a G {A^{t,T))y such that, P-a.s., 


7 ,7 


V^{t,x,p,q)> essinf V 


PiQjE[gij{XT )|-Eo,tj._2] £. 

i=l j=l 


(3.14) 
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From Lemma l3.II and (|3.14|] . we have 


I J 


V^{t,x,p,q) = E[V^{t,x,p,q)] > ^ -e 

i=l j=l 

I J 


(3.15) 


a&(A^(t,T)Y 


^}£- ^• 


i=l j=l 


Thanks to (|3.15l) holds for any /3 E T)y and from the arbitrariness of s, we have V'^{t, x,p, q) > 

V'^{t,x,p,q). On the other hand, for any e > 0, there exists /3 E {t,T))‘^, such that, P-a.s., 


1 J 


V^{t,x,p,q) < essinf V^PigjT^bii(^r"'’""^') 1-^0, 4 - 2 ] +‘ 


I J 


(3.16) 




qiqjXj[yij\y\ 

i=l j=l 

From Lemma l3.ll thanks to (I3.16p holds for every a E (^’^(t,T))^, we have 

/ J 

V^{t,x,p,q) = E[V'^{t,x,p,q)] < ^ (X^"^’"*’^')] +e 

i=l j=l 

I J 

rt,x,ai,/3j 






(3.17) 


I J 


< sup inf y2y2P^9jE[gij{Xy'’°'^’^y]+e = V'^{t,x,p,q)+e. 

Thus, we obtain V'"{t, x,p, q) < x,p, q). Finally, from Step 1 and Step 2, we have x,p, q) = 
V^{t,x,p,q) = V^{t,x,p,q). □ 


We now prove that when the mesh of the partition vr tends to 0, the functions Wi and 
converge uniformly to the same function which is the unique dual solution of some HJI equation. 

Lemma 3.2. The functions W[ and are Lipschitz continuous with respect to {t,x,p,q), uni¬ 
formly with respect to tt. 


Proof. We just give the proof for Vy the proof of Wf is similar. 

Since the cost functionals gij are bounded, from the definition of , we obviously have that 
is Lipschitz with respect to p and q. For any t E [0, T], (rt, v) E Ut^r x Vt^Tj from (12.2|] . the functional 
gij{Xy’^'^) is Lipschitz continuous with respect to x, then for any {a, /3) E {Ai{t, T)y x{Bf {t, T))'^, 
we have that J{t,x,a, (3,p,q) is Lipschitz continuous with respect to x. Moreover, the Lipschitz 
constant only depends on the Lipschitz constants of gij and the bound of /. Thus we have Vy is 
Lipschitz with respect to x. 

Now we only need to show Vy is Lipschitz with respect to t. Let x E M"", {p, q) E A(/) x A(J), 
and t < t' < T he arbitrarily fixed. Let j3 = (/3j)j=i,2,...,j £ {Bf{t,T)y be an e-optimal strategy 
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for Vi{t,x,p,q). We define a strategy /3'- E associated with /3j. For this end, we put for 

all u E Ut^T, 

where i(e) = | J ^ 

and u E f7 is an arbitrarily given constant control. 

If t' < ffc, then Pj E Bl{t',T) and we define /3' = Pj. Otherwise, we let /> A; + 1 be such that 
ti-i < t' < ti- We now consider 2{l — k) + 1 random variables * = 1)2, 

defined on ([0,1],.8([0,1]),dx) with = x, x E [0,1], which are mutually independent, 

independent of Qj, (i,j) ^ (2,/ — 1), and uniformly distributed on [0,1]. Then the composed 
random variables o CJ/-d dl-i ° C 2 i-D • • • > d/-i ° C 2 /-d mutually independent, independent 
of all Cfj) (bj) 7 ^ (2,^ — 1), uniformly distributed random variables. 

For any u E Wt',T) s E [^^T'], we define 


P'j{uj,u){s) 

N 

= ^ ° C2,/-l)dfc-l ° C2,«-l) 

m=l 


■ ■ 1 dZ-1 ° C2,«-l) Cpz-l) 


/-TT /-TT 

S; ? • • • ? 2’ 


C2,m-l)(‘^))^)(s) • 


where u){s) = j3j{uj, Then we have /3'- E Bi{t' ,T). Notice that for all u E 

Ut'^Ti and /3j{u) obey the same law knowing C/hi: ■ • •: C/v-i- Therefore, E[gij{Xrp’ ’ ’ ^ )] = 

Then for all a E {Aj{t',T)y, 


J{t',x,a, {/3j),p,q) = J{t',x,a, 0j),p,q). 


(3.18) 


Now for any a E A\{t',T), we define a strategy a' E AI^^T) associated with a as follows, for all 
V E Vt,Ti 


I u(s), sE[t,f') 

1 a;(iJ,y\[t',T])(s}, s E [t',r] 


Through the above construction and from Lemma 12.11 the couples of admissible controls related 
to the couples of strategies (a',/3j) and (a,/3j) coincide on the interval [^^T]. Hence, using the 
standard estimate and Gronwall inequality we have 


E[\X^ 


t,x,a' 


,x,ck,/3j 


|] <M|f'-t|, sG[t’,T], 


(3.19) 


where the constant M only depends on the bound of / as well as the Lipschitz constant of /. Thus, 
for any a E {Ai{t',T))y from (I3.18p . (I3.19P and (|2.9p . we have 

J{t',x,a, {I3j),p,q) = J{t',x,a, {Pj),p,q) > J{t,x,a', P,p,q) - C\t' - t\ 

> inf J{t,x,a',P,p,q)-C\t' -t\>Vy{t,x,p,q)-e-C\t' -t\, 
a"eiAJit,T)y 


Therefore, 


Vy{t',x,p,q) > Vy{t,x,p,q) - e - C\t' -t\. 


(3.20) 


Similarly, if we assume that /3 E {Bi{t',T)Y is e-optimal for Vi{t',x,p,q), then we can get 

Vy{t,x,p,q) > Vy{t',x,p,q) -e-C\t' -t\. (3.21) 

Moreover, from the arbitrariness of e > 0, we obtain Vy is Lipschitz continuous in t. □ 
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Lemma 3.3. For any {t,x) G [0,r] x MF, the functions Wi{t,x,p,q) and {t,x,p,q) both are 
convex in p and concave in q on A(/) and A(J). 


Proof. We just give the proof for ^ the proof of Wf is similar. 

It is obvious that 

I J 

Vf^{t,x,p,q) = sup Vpi inf '^qjE[gij{X. 
(/3,-)6(Bf(t,T))^ ae.4J(i,T) 


t,x,a,0j 


)]• 


(3.22) 


then we know V{'{t,x,p,q) is convex in p. 

Now we prove that {t,x,p,q) is concave in q. Let {t,x,p) G [0,r] x M" x A(/), q^,q^ G 
A(J),A G (0,1), and let = (/3°)j=i,...,j G and G {l3f{t,T)y 

be e-optimal for {t,x,p,q^) and Vi {t,x,p,q^), respectively. For q^ = (q]',...,gj) and q^ = 
(gJ,...,gj), we define gj' = (1 — A)g° + Agj and q^ = [q^,... ,q^) G A(J). Without loss of 

generality, we assume > 0, j = 1,..., J, then we define Cj = - 3 = J■ For a; G 12, 

u G Ut^T, s G [t,T), we define the strategy = (/Sj')j=i,,,,,j and /3j'(yi,.. ■ ,y 2 (N-k)+i,u)is) = 

13j{yi,y2, - ■ ■ ,y2{N-k),i-y2{N-k)+i,u)is) + P }(yi,y2, • • •, y2{N-k), (y2(7v-fc)+i -Cj),u)is), 

N 

where /3;-((Cfc_i, • • •, C]^_ 2 , C 2 ,iV-i)(‘^)> ^)(«) = E ^r-2> C2,i-i)(t^), ^^)Vh-i,*;](«)> ^ = 

l=k 

0,1, respectively. Then we have {/3f) G {Bf{t,T))'^. Therefore, we have 


/ J 

inf J{t,x,ay^,p,qy ='S2Pi 
ae(.4Jd,T))^ ^ ae.4fd,T)^ 

I —1 J — i 


)] 


I J 

Pi inf qf 


[0,Cj 


)J«y2(Af-fc)+l 


f r , iCr.fe-l’Cfe i-c ■ (y2(iV-fc)+l Cj))(a;),-) 

+ / )J«2/2(Ar-A:)+l 

/ J 

Pi inf q^ 


(1 - A)g° 




> (1 - A) Pi ^ Jijf S Ij-Eby )1 + A XIB „ j;[, „ S 

2=1 ^ ’ j = ^ ^=1 ^ 

> (1 - X)V{'{t,x,p,qy + A 17 (t,x,p,g^) - 2e, 

since and X are e-optimal strategies for Vi {t,x,p,qy and Vi {t,x,p,q^), respectively. Thus, 

V{{t,x,p,qy > inf J{t,x,ay^,p,qy > {1 - {t,x,p,qy + XV{{t,x,p,q^) - e. (3.23) 
ae{A^{t,T)y 




)] 


Thanks to the arbitrariness of e, we obtain the desired result. 


□ 


Now we introduce the Fenchel transforms (refer to [5]). Assume a mapping V’ : [0,T] x x 
A(/) X A(J) —>■ M convex in p and concave in q on A(/) and A(J), respectively, then we define its 
convex conjugate (with respect to variable p) if* by 

'tjj*{t,x,p,q) = sup {p ■ p —‘ip{t,x,p,q)}, (t, x,p, (?) G [0, T] x M"" x x A(J), (3.24) 

peA(/) 
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and its concave conjugate (with respect to variable q) by 

= inf {q-q-'ip{t,x,p,q)}, {t,x,p,q) G [0,T] x x A{I) x . (3.25) 

qeA(j) 

Using these notations we denote by Vj^* for the convex (respectively, concave) conjugate of 

Vi (respectively, VUf) with respect to p (respectively, q). 

Lemma 3.4. For all {t,x,p,q) E [0,T] x M” x x A(J), we have 

J 

Vi*{t,x,p,q) = inf sup max {pi — qjE[gij{x!pf’^'^^)]}. (3.26) 


Proof. We define 


F(t,x,p,,) = - E®®te(W'"’'’01}. (3.27) 

It is obviously that F(t,x,p,q) is convex with respect to p. From (I3.24p and (|3.27l) . we have 

.7 

F*{t,x,p,q) = sup{p-p- inf max {pi - inf 

(Pj) iS{l,...,i} '3' 


7=1 

J 


= sup sup min {p ■ p - pi + QjE[gij )]} 

(/3,.)peR^i6{l....,7} a ^ 

= sup sup min {p-p — pi + hi}, 

(Pi) psR^ *e{i,...,7} 


(3.28) 


where we define hi := inf ^ qjE\gij{xlff’°^'^^)], 1 <i < F 

“ 7=1 

On the other hand. 


sup min {p ■ p — pi + hi} = snp{p ■ p + min {/ij — pi}} = sup {p • p + _ inf {h — p)p} 

iefl,...,/} pgR^ is{l,...,7} pgR^ :PSA(7) 

= sup _ inf {{h — p)p + p ■ p} = 'mi sup {{p — p)p + h ■ p} (3.29) 

pgR^ :p6A(7) P&A{I) pgR/ 

= h ■ p. 


From ()3.28p . ()3.29p and (I3.22p . we get 

I J 

F*{t,x,p,q) = sup'^ Pi ini'^qjE[gij{X^rf'’'^'^^)] = Vi{t,x,p,q). (3.30) 

ihj) i=i “ j=i 

Since F is convex in p, we have 'Vp* = F** = F. □ 

Using the definition of Vp* and Wf^, from Lemma 13.21 we have the following lemma. 

Lemma 3.5. For all the partitionir of the interval\Q,T], the convex conjugate function V^* {t,x,p,q) 
is Lipschitz with respect to {t, x, p, q), the concave conjugate function Wf^{t, x, p, q) is Lipschitz with 
respect to {t, x,p, q). 
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Generally speaking, the game with asymmetric information does not have the dynamic pro¬ 
gramming principle, but it has s sub-dynamic programming principle. 

Lemma 3.6. For any {t,x,p,q) G [tk-i,tk) x x x A(J), and for all I {k < I < N), we have 


Vi*{t,x,p,q)< inf sup E[Vi*{ti,Xlf’°‘’^,p,q)] 


Proof. We define 


G{t,ti,x,p,q) 


inf sup E[Vf 




For any given e > 0, let /3^ G be an e-optimal strategy for G{t,ti,x,p,q), i.e., 

\G{t,ti,x,p,q) - sup E[V{'*{ti,Xlf’°'’^\p,q)]\ < e. 

QeAJ{t,ti) 


(3.31) 


(3.32) 


(3.33) 


For any y G there exists an e-optimal strategy = (/3|)j=i,..,,j G for Vp*{ti,y,p, q) 

for Player II, i.e., 

\Vi*{ti,y,p,q) - sup max {pi - VgjF;[c/y(Xy ^’“’^")]}| < e. (3.34) 

t y <y. fP' 

Because sup„g_4Y [pi - Yl'j=i (ljE[gij{X^’ ’ ’ ")]} and Vp*{ti,y,p,q) are Lipschitz 
continuous with respect to y, is a (2e)-optimal strategies for z,p,q), if z G Br{y), where 

Br{y) is the ball with small enough radius r. 

Since the coefficient / is bounded, there exists some R > 0 large enough such that all the value 
of belong to the ball i?/j(0). Then we assume (On), n = 1,..., no, is a finite Borel partition 

of Bii{0). For any Xn G On, we denote /I” = /JJ", n = 1,... ,no, the strategy (/?”) is (2e)-optimal 
for Vp*{ti,z,p,q), for any z G On, i.e., 

j 

\Vi*iti,z,p,q) - sup max {pi -^qjE[gij{x!l.’''’°‘’^^ )]}| < 2e. (3.35) 


For any uj G 0 and u G V(t,T, define 


j3j{uj,u){s) = 




s G 


no 


E i3jiu},u\[ti,T)) ■ X’ 

n=l ^ "1 

Then, we have /3j G Bf{t,T). For any a G AJ{t,T), we know a has the following form: 


a(w,u)(s) = am((Cr,fc-l,C2,fc-l,---,Cr,m-l)(‘^)>^)(«)Vi™-l4ru)('S) 

m=k 

N 

+ Y/ C2,fe-1) • • • ) Cgz-l) Cgi-1) CgZ) C/+1) ■ ■ ■ , Cm-2) Cl)m-l)(a^)) ^)('5)-^[t^_l,t™)(s)- 


m=l+l 
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For s E [ti,T], we define a{ui,Q,v){s) = Em=«+i (C^o CJ,;, • • •, 

where Q is a 2(1 — k) + 2-dimensional constant vector. Obviously, we know a{Q) E AJ Then 

for any a E Al{t,T), due to and Qo = {Clk_i, Clk-v ■ ■, Ch-v Cli-i) are 

measurable, /3” and a are Ti;_^^'r-iiieasurable, we have 


^0 , ~ 
N. 1 _ Tp\\ ^ ^ /'V 


E[g,jiX^^ 

no 

= E[J2E[gij{X, 


)]=E[Y^g,j{X, 

n=l 

ti,y,a{Q)^P’i 


«(<3o),/3", ^ 

) • / 




n=l 




• L 


,Q=Qo 




GOn} 


From (|3.36p . ()3.35p and P3.33F we have 

max {Pi -'^qjE[gij{x!^'"’'^’^^)]} 


= max 

no 


J no 

ax^ |pi - E[gijiX, 


ti,yMQ)P7 


i=i 


n=l 


)\=xIP’^’>^\q=Qo ■ 


<E[ E. max {pi E QjE[gij{X, 


ti,y,a{Q)P"i 


n=l 

no 




i=i 


'I 


y=Xlp’°‘’^\Q=Qo ■ 


^a'e.4f(ti,T)*6{h...d} ^ 

no 

<E[J2 vr{ti,xlf’^’^\p,q) • / ,0 ] + 2e 


ti,y,a',/3n 




n=l 

<G{t,ti,x,p, q) + 3e, 


(3.36) 


(3.37) 


which means that Vp*{t,x,p,q) < G{t,ti,x,p,q). 


□ 


We assume {TTn)n>i is a sequence partitions of the interval [0, T] satisfying that when n —>■ oo, 
the mesh of the partition Ivr^l tends to zero. From Lemma f3.5l applying the Arzela-Ascoli Theorem 
to Vi'^* {t,x,p,q) and Wi’^^{t,x,p,q), we have the following lemma. 

Lemma 3.7. There exists a subsequence of partitions (7r„)n>i; still denoted by (7r„)n>i and two 
functions V : [0,r] x M"' x x A(J) i—)■ M and W : [0, T] x M" x A(I) x M such that 

{V,W) uniformly on compacts in [0,T] x x A(/) x A(J) x x 

Remark 3.1. Notice that from Lemm.a, \S. ,71 the limit functions V and W are Lipschitz continuous 
with respect to all their variables. 


Now we prove that the limit functions V and W are a viscosity subsolution and a viscosity 
supersolution of some HJI equation, respectively. For more details on viscosity solutions, the 
reader is referred to [7] . 

Lemma 3.8. The limit function V{t, x,p, q) is a viscosity subsolution of the following HJI equation 

_ n g [q^t] X M", 


%{t,x) + H*{x,DV{t,x)) = 0, 

J 

V{T,x) = max {pi - Y, Qjgijix)}, {p,q) x A(J), 

j=i 


(3.38) 
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where 


H*{x,^) = = inf sup ( [ f{x,u,v)fj,{du)u{dv)-^) 

Juxv 

= sup inf ( / f{x,u,v)fj,{du)iy{dv)-^). 

JuxV 

Proof. For simplicity, we denote V{t,x,p,q) by V{t,x), for fixed {p,q) G x A(J). For any 
fixed {t,x) G [0,r] X M"', since the coefficient / is bounded, there is some M > 0 such that, 
Bm{x) D {s,y) G [0,r] X Bi{x),{a,P) G AJ{s,T) x Bf{s,T),r G [s,T]}, where Bm{x) 

is the closed ball with the center x and the radius M. From Lemma [37n we know converge 
to V over [0, T] x Bm{x). Let (/? G C'^([0,r] x M"’) (the set of bounded continuous functions where 
the first order partial derivate is bounded and continuous) be a test function such that 

{V - ip){t,x) > {V - Lp){s,y), for all (s,y) G [0,r] X 5m(x) \ {(t,x)}. (3.39) 


Let {sn,Xn) G [0,r] X Bm{x) be the maximum point of — ip over [0,r] x Bm{x), then there 
exists a subsequence of {sn,Xn) still denoted by (sn,Xn}, such that (sn,Xn) converges to (t,x). 

Indeed, since [0,T] x Bm(x) is a compact set, there exists a subsequence (sn,Xn} and (s, x) G 
[0,r] X Bm(x) such that (sn,Xn) —>■ (s,x)- Due to (Vi"* — ip){sn,Xn) > {V^^* — (p){t,x), for n > 1, 
we have 

{V - (p){s,x) > {V - p){t,x). (3.40) 

From ()3.39p and (j3.40j) . we have (s, x) = (t,x). 

For the partition iTn, we assume _ < Sn < for simplicity, we write t'^_i < Sn < Since 
Xn X, there is a positive integer N such that for all n > N, we have \xn — x| < 1. Then from 
Lemma iTGl we get 


PiSn,Xn) = Vf'^*{Sn,Xn) < inf SUp (t^, 


< 


inf 


/3GBF 


sup F;[<^(t^,X*f’""’“’^)]. 


(3.41) 


Thus we get 


0< inf sup - ip{Sn,Xn)] 


= inf 


sup E[ I "(^(r,X^""’^"’"’^) + /(X^"-’^"’“’^,a^,/3r) • Dip{r, 




(3.42) 


dr 


For {u,v) G Ut^T X Vt,T, we introduce the following continuity modulus. 


dip 

m{6) := sup \{^{py) + fiv^u^v) ■ Dip{r,y)) - {^{s,x) + f{x,u,v) ■ Dip{s,x))\- 

lr - s| + |y - x| ^ 5, dr or 

u £ U,v £ V,x,y £ Bm C^) 

(3.43) 

Obviously, m{S) is nondecreasing in 6 and m{6) —0, as (i | 0. From (12.2p . considering that 
|^s„,xn,a,/3 _ ^^1 ^ ^ — Sn|, r G [sn,tfc] and from (I3.43p we know that 




dtp 
■ dr 


{Sn, Xn) + fiXn, Or, Pr) ' D(p{Sn, Xn))\ < m{C\tl - Sn|), r G [Sn, t^]. 


(3.44) 
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It follows from (j3.42l) and (I3.44p that 


- (ik - Sn){^iSn,Xn) + m{C\tl - Sn|)) 

< inf sup E[l f{Xn,ar,Pr)-Dip{Sn,Xn)dr] 

aeAi^{Sr„t") Jsn 

< sup E[ f{Xn,ar,/3r)-D(p{Sn,Xn)dr], 


(3.45) 


where we take I3r = viQt-i)^ ^ ^ h is a 14-valued measurable function. Define pn = 

i^k ~ from (|3.45l) there exists a pn-optimal strategy (depending on /?) such that 


dip 

- {tl - Sn){-^{Sn,Xn) + m{C\tl - Sn|) (t^ - 5^)) <E[ f{Xn,a^,Pr) ' Dp{Sn-, Xn)dr] 

'J Srn. 


(3.46) 


E[f{Xn,a'!^{Ci"k-vV),v{C2"k_i)) ■ Dp{Sn,Xn)]dr. 


Notice that on the interval does not depend on the control v due to the delay property. 

Then thanks to the independence between Ci^k-i ^ 2 %-!^ from (I3.46P we get 


- (4 - Sn){^{Sn,Xn) + m{C\tl - S„|) + (t^ - S„)) 


< 


Ek f 

/ sup / E[f{Xn,U,v{C2l_i)) ■ Dp{sn,Xn)]p{du)dr. 

Jsn tk&PiU) Ju 


From the arbitrariness of v, from (13.471) we get 


- (tl - Sn){^{Sn,Xn) + m{C\tl - S„|) + (t^ - S„)) 
f 


inf sup 


f{xn,u,v) ■ Dp{sn,Xn)p{du)u{dv)dr 


Js„ fk&V{U)JUxV 

= (^fc-'Sn) inf sup / E[f{xn,u,v) ■ Dip{sn,Xn)\p{du)u{dv), 
y&ViV) neP(u)JuxV 


(3.47) 


(3.48) 


which means that 


“ {-^{Sn, Xn) + m{C\t^ — s„|) + (t^ — S„)) 

f (3.49) 

< mf sup / E[f{Xn,U,v) ■ Dp{Sn,Xn)]p{du)l2{dv). 
y&V{V) ^er{U)JuxV 

Recall that (s„, Xn) (t, x) and 0 < (t^ — Sn) < (t^ — t'k-i) — n ^ oo we get 

'^{t,x)+ inf sup [ f{x,u,v)-Dp{t,x)p{du)i2{dv)>0. (3.50) 

ot fiep\u)Juxv 

□ 
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Now we want to prove is a viscosity supersolution of the HJI equation (13.381) . Notice that 




sup 


inf 






(3.51) 


Then —Wi{t,x,p,q) has the same form as Vi , only change the role of players. Thus, the con¬ 
vex conjugate —W[{t,x,p,q) with respect to q, i.e., —{Wi^{t,x,p,—q)) satisfies a sub-dynamic 
programming principle. Then similar to Lemma [3.61 and Theorem 13.81 we have the following result. 

Lemma 3.9. For any {t,x,p,q) G [0,T] x R” x A(/) x R'^, and for all I {k < I < n), we have 

Wf*{t,x,p,q)> sup inf ,p,q)f (3.52) 


and W {the limit of {Wf’^^ 


) on compacts) is a supersolution of the HJI equation (I3.38P . 


We now give the definition of dual solutions for the following HJI equation 

r %{t,x)+H{x,DV{Fx))=t), (t,x) G [0,r] xR", 

\ V{T,x) = (p,g) G A(/) X A(J), ^ 

where H{x,C) = inf^gp(fj) (/(jxv/(®> 'O' 

Definition 3.1. A function w : [0, T] x R”" x A(/) x A( J) i—)• R is called a dual viscosity subsolution 
of the equation (I3.53P if, firstly, w is Lipschitz continuous with all its variables, convex with respect 
to p and concave with respect to q, secondly, for any {p,q) G A(/) x R'^, w^{t,x,p,q) is a viscosity 
supersolution of the dual HJI equation 

dV 

— {t,x) + H*{x,DV{t,x)) = t), (Lx) G [0,T] X R*", (3.54) 

where H*{x,f) = —H{x,—f). 

A function w : [0,T] x R"’ x A(/) x A(J) i-^ R is called a dual viscosity supersolution of the 
equation (13.531) if, firstly, w is Lipschitz continuous with all its variables, convex with respect to 
p and concave with respect to q, secondly, for any {p,q) G R^ x A(J), w*{t,x,p,q) is a viscosity 
subsolution of the dual HJI equation ()3.54p . 

The function w is called the dual viscosity solution of the equation (I3.53p if w is a dual viscosity 
subsolution and a dual viscosity supersolution of the equation (|3.53l) . 


Lemma 3.10. Let wi,W 2 ■ [0,T] x R"" x A(/) x A(J) i—>■ R 6e a dual viscosity subsolution and 
a dual viscosity supersolution of the HJI equation (13.531) . respectively. If, for all {x,p,q) G R"^ x 
A(/) X A(J), wi{T,x,p,q) < W 2 {T,x,p,q), then we have wi < W 2 on [0,T] x R*^ x A(/) x A(J). 


The proof of Lemma 13.101 is referred to Theorem 5.1 in [5]. 

Theorem 3.2. The functions {Vff'^) and {Wf") converge uniformly on compacts to a same Lips¬ 
chitz continuous function U when the mesh of the partition Tin tends to 0. Moreover, the function 
U is the unique dual viscosity solution of the HJI equation (13.531) . 


For this we first prove the following proposition, then we get Theorem 13.21 directly. 
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Proposition 3.1. There exists a subsequence of partitions Tin with |7r„| —>■ 0, still denoted by 
{'^n)n>i such that and {Wf") converges uniformly on compacts to the same function U, and 

the function U is the unique dual viscosity solution of the HJI equation (j3.53l) . 

Remark 3.2. If Proposition AS. i1 holds, then there exists a sub-subsequence (vr^J such that ) 

converges uniformly to the function {U, U) and the limit U is the unique dual solution of the HJI 
equation (j3.53p . Therefore, the limits of all converging sub-subsequences are the same, then Theorem 
13.^1 holds. 

Now we prove (of Proposition 13.Ih . 

Proof. From Lemma 13.21 using the Arzela-Ascoli Theorem we know there exist two bounded Lip- 
schitz functions Pi and Wi : [0,T] x x A(I) x A(J) ^ M such that (VY,WY) {Vi,Wi) 
uniformly on compacts in [0, T] x MT x A(/) X A(J), and (Pi, Wf) are convex in p, concave in q. 

From Lemma [321 W = lim , V = lim VY* ■ We know V* and are a dual viscosity 

n^oo n^cxD _ 

supersolution and a dual viscosity subsolution of HJI equation (I3.53|] . respectively, and the terminal 
value V*{T,x,p,q) = W"^{T,x,p,q) = Ylij Then from Lemma [3.101 we have 

P* > W*, on [0,r] X X A(/) x A(J). (3.55) 

Since Pi(t, x,p, q) = lim VY{t, x,p, q) for any M > 0 and (t, x,p, q) G [0, T] xBmY) xA(I)x A( J). 

n^oo 

Then for any p > 0, we know there exists a positive integer Np^M, such that for any {t,x,p,q) € 

[0, T] X Bm{0) X X A(J), it holds |P]^"(t, x,p, q) — Pi(t, x,p, g)| < p. Thus, from the definition 
of convex conjugate we have 

\VY*{t,x,p,q) -Vf{t,x,p,q)\ = \ sup {p ■ p - VYit,x,p,q)} - sup {p ■ p - Vi{t, x,p, q)}\ 

peA(/) pgA(/) 

< sup \VY{t,x,p,q)-Vi{t,x,p,q)\ < p. 
pe^{i) 

Therefore, Vf{t,x,p, q) = lim VY*{t,x,p,q). Therefore, P = lim VY* = bP, since Pi is convex 

n^oo n^oo 

in p, we have Pi = Vf* = V*. Similarly, we have IPi = . Prom (j3.55jl we have 

IPi < Pi, on [0,r] X X A{I) X A{J). (3.56) 

On the other hand, knowing that IP^" > Pi’^", we have 

IPi > Pi, on [0,r] X X A{I) X A{J). (3.57) 

From (j3.56p and (|3.57p . we know that U := Vi = Wi on [0,r] x x A(/) x A(J). Furthermore, 
from the above proof, we also know that U is the unique dual viscosity solution of HJI equation 
(13331) . □ 

From Theorem 13.11 and Theorem 13.21 we obtain the following result directly. 

Theorem 3.3. The functions {V^") and (JP^**) converge uniformly on compacts to a same Lips- 
chitz continuous function U when the mesh of the partition iTn tends to 0. Moreover, the function 
U is the unique dual viscosity solution of the HJI equation (I3.53P . 
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4 Nash equilibrium payoffs for nonzero-sum differential games with symmetric 
information and withont Isaacs condition 


In this section we consider the existence of Nash equilibrium payoffs for nonzero-sum differential 
games with symmetric information (i.e., / = J = 1) and without Isaacs condition. From Theorem 
EH we only need to consider the strategies a G and fi G B\{t,T) for our nonzero-sum 

games. Let gi : M”' i-t- M and g 2 '■ M” M be two bounded Lipschitz continuous functions. For 
(t,x) G [0,T] X M”, (m, u) G x (the definition of and refer to Remark l2.2j) . we 
define 

Ji{t,x,u,v) = E[gi{x!f''^''’)] and J 2 {t,x,u,v) = E[g 2 {X^''’''’'^)], (4.1) 

where X^’^’^’'^ is the solution of the equation (12.ip . From Remark 12.11 we know for any {a,l3) G 
Ai{t,T) X there exists {u,v) G x such that a{v) = u,l3{u) = v. Thus, we have 

Jmit, X, a, (5) = Jm(i, X, u, v), m = 1,2, respectively. 

Here, for the nonzero-sum differential games Player I wants to maximize Ji{t,x,a, P), while 
Player II wants to maximize J 2 {t, x, a, (5). In general, a Nash equilibrium point is a couple strategies 
(q;,/ 3) such that for any other couples of strategies (a,/3), it holds 

Ji{t, X, a, P) > Ji{t, X, a, (3), and J 2 {t,x,a, P) > J 2 {t,x,a, (3), (4-2) 

and the pair {Ji(t,x,d, /3), J 2 {t,x,d, P)) is called a Nash equilibrium payoff. 

In our paper, we only concern the existence of the Nash equilibrium payoff which can be 
approximated by (Ji(t, x, d'^, /3'^), J 2 (t, x, when e tends to 0. Now we first give the definition 

of a Nash equilibrium payoff for our nonzero-sum differential games. 

Definition 4.1. A couple ( 61 , 62 ) G is called a Nash equilibrium payoff (NEP, for short) at 
the position (t,x), if for any e > 0 , there exists 5^ small enough satisfying that for any partition 
TT of the interval [0,T] with | 7 r| < 5^, there exist {a^,l3^) G Af{t,T) x Bf{t,T) such that for all 
{a,f3)GAj{t,T)xBf{t,T) 

Ji{t, X, a^,(3'^) > Ji{t, X, a, /3^} — e and J 2 {t, x, a'^,f3‘^) > J 2 (t, x, a’^,13) — e, (4.3) 

and 

for m = 1,2, \Jm(t,x,a^,/3'^) — em\ < e, respectively. (4.4) 

The following lemma gives an equivalent condition of assumption (|4.3I) which will be frequently 
used in this section. 


Lemma 4.1. We assume e > 0 and {W 
only if for any {u, v) G x , 


f3'^) G A\{t,T) X Bf{t,T). Assumption ^.3\) holds if and 


Ji{t, X, a^,l3^) > Ji{t, X, u, I3‘^{u)) — e and J 2 {t, x, W,/3^) > J 2 (t, x, W{v),v) — e. 


(4.5) 


Proof. We assume (14.3p holds, then for any fixed u G define a(v) = u, for all v G then 

we know a G Af{t,T). Thus, from condition (14.3p . we have Ji{t,x,W, j3^) > Ji{t,x,u, j3’^{u)) — e. 
Similarly, for any v G we obtain J 2 {t,x,W, (3'^) > J 2 {t,x,W{v),v) — e, then condition ()4.5p 

holds. 

Conversely now (j4.5p holds, for any a G A'l{t,T), from Remark 12.21 there exists {u,v) G 
X such that, a(v) = u,/3'^{u) = v. Then we know 

Ji(t, X, a, (3^) — e = Ji{t, X, u, /3^(n)) — e < Ji{t, x, W,f3^). 

Similarly to J 2 , then we get condition (14.3h . □ 
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From Theorem 13.21 we know the upper value function and the lower value function 
converge to the same function without Isaacs condition. Thus we can denote the following functions 
Ui{t,x) and U 2 {t,x): 


Ui(t,x)= lim inf sup Ji(t,x,a,B) 
and similarly, 


lim sup inf Ji(t, x, a, j3), 
aeAl{t,T) 


(4.6) 


U 2 {t,x)= lim sup inf J 2 {t,x,a, P) = lim inf sup J 2 {t, x, a, (3). (4.7) 

kK0/3eBI(t,r) aeAJ{t,T) |7r|^>0oe.4J'(t,T) 


Now we announce the following two important results for our nonzero-sum differential games. 


Theorem 4.1. (Characterization) A couple ( 61 , 62 ) E is a NEP at the position {t,x) if and only 
if for any e > 0, there exists 5^ satisfying that for any partition -it = {0 = to < ti < ■ ■ ■ < t]\f = T} 
with | 7 r| < Se and t = tk-i, there exists {u'^,v'^) E x such that for i = k,...,N and 
m = 1,2, respectively, 




(4.8) 


and 

|i?b„.(X^"’“'’"')]- 6 ^|<e. (4.9) 

Theorem 4.2. For any initial position {t,x) E [0, T] x M”, there exists some NEP at the position 
{t,x). 


The rest of this section mainly gives the proof for the above theorems, we first prove Theorem 
O and then from this characterization, we prove the existence result (Theorem 14.2|] . First of all, 
we give the following lemma which will be used to prove Theorem 14.11 and 14.21 


Lemma 4.2. a) Fix {t,x) E [0,r] x M”. For any e > 0, for any partition tt = {0 = to < ti < 
■ ■ ■ < tN = T} with |7r| < 6^ (small enough) and t = tk-i, any fixed u' E , there exist strategies 
a* E .4.1 (t, T), i = k,..., N, such that for any v E 


a*(u) = u', P-a.s., on [t,ti-i], 


(4.10) 


b) Fix {t,x) E [0,T] x M". For any e > 0, for any partition t: = {Q = to < ti <■■■< t^ = T] 
with | 7 r| < 6e (small enough) and t = tfc-i; any fixed u' E there exist strategies a* E .4i(t,r), 
i = k,..., N, such that for any v E 


a^(v) = u', P-a.s., on [t,ti-i], 


(4.11) 


Proof. We just give the proof for a), the proof of b) is analogous. 

For any e > 0, y E any fixed i, from the definition of the value function U 2 , there exists a 
strategy Uy E .4i(tj_i,r) such that 


U2{ti-i,y) = lim inf sup E[g2{X^rf 

> inf sup E[g 2 {x!f~^’^’°‘’^)] — - (since | 7 r| < 6^) 

aeA1iti-i,T) 4 


(4.12) 


> 


mf sup E[g 2 {Xrj. "''')]--> sup E[g 2 {Xj, )] -- 


O^GA'^ {ti—\,T) ^^y7r,l 


4 ^.,77,1 

llSV, 
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Since the coefficient / is bounded, for any {u,v) E x there exists a constant R> 0 such 
that < R. Then there exists a hnite partition (Oi)«=i, 2 ,...,n of the closed ball Br{0) with 

diam(Oj) < e/(4C'). For any I, from (14.121) there is some yi E Oi with 


Vz E Oi, sup E[g 2 {x!^ ^ U 2 {ti-i,z) + e, 

VGV.' ^ rj. 


(4.13) 


since U 2 {ti-i,z) and sup, 






ti — l^Z,OLt{v),V 

E[g 2 {Xj, ' )] are Lipschitz continuous with respect to z. 


For any v E from the definition of the control v, it has the following form (refer to Remark 


N 


u(w, s) — U^(s, C 2 ,fc-l)-^[t,tfe)(s) + ^ Cfc- 1 ) • • • ) 0-2) C2,Z-l)-^[ti_l,4i)(s)) (4-14) 

then for s E we define 


N 


'{iO, Q, s) — ^ v’'{s, Q, C 2 ,i- 1 ) Cgi-l) C 2 ,i) • ■ ■ ) 


(4.15) 


l=i 


where Q is a 2{i — A:)-dimensional constant vector. Therefore, v" E and we define the 

following strategy a®, 


u', 


Vu E ) Ot (u) . \ ^ . H (r\ {+ T^l w r -yt,x,u',v \ (4‘Ri) 

<Av"iQo,s)), on (ti_i,r] X {Xd E O/j, 


where Qo = (C^k-v Cgfc-D ■ ■ ■) (2,1-2^ Cli-2)- Then, a® E {t, T). Notice that Qq and ’®’ are 

all J^tj,_2,ti_2-measurable, v"{Q,s) and a'y^{v"{Q, s)) are all J't._2,T-measurable. Therefore, for all 
V E from ( 14 . 13 ^ we have, P-a.s., 


E[g2{X^' ^ )\Et,_„u.^] = 2^E[g2{X^ )]^_ 


1=1 


T )\q=Qq,z=xI'^X''’ ■ 


< ^ c/2(t.-i,x*;:f'®®) • ^ = U2{ti-i,xi:r:f^^^n + e. 


1=1 


(4.17) 

□ 


Now with the help of Lemma 14.21 we will prove Theorem 14.11 


Proof. Sufficient condition. 


Let us assume that ( 61 , 62 ) satisfies condition (|4.8n and (|4.9p of Theorem 14.11 namely, for any 
6 > 0 , there exists 5^ small enough satisfying that for any partition tt = {0 = t^ < ti < ■ ■ ■ < t^ = 
T} with | 7 r| < 5f: and t = there exists {u^,v^) E x such that for z = A;,..., and 


m = 1, 2, 


P{E[gm{x!f^'^ ’®® )\Et,_,,u_,] > UmiU-i,Xlfj;^ 


(4.18) 
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and 




(4.19) 


Then we will prove that (61,62) is a NEP for the initial position {t,x). For this, we construct 
(a^,/?'^) G Ai{t,T) X satisfying (I4.3jl and (14.41) . 

Since Qm^rn = 1,2, is bounded, without loss of generality, we assume Qm > 0, which means 
Wm > 0, for m = 1,2, respectively. Suppose eo = g_|_4Vc (h,h) = (n^°,n^°), then (14.181) and 

14.191 also hold for e = cq. From Lemma 02] o); let n' := u, there exist strategies ai G ^^(t, T), 
i = k,... ,N, such that for any v G 


ai{v) = u,P-a.s., on 

< [/2(t,_i,X*:^f (")’") + |, P-a.s. 


(4.20) 


For any v G we introduce the stopping times = inf{s|ns 7^ t < s < T} A T, r'^ = 

inf{ti_i|ti_i > S'", k + 1 < i < N} A T. Now we define as follows: 


Vn G a^(n) | ^ ^ 


_ / n, on[[t,r^]]. 


Then G .A4(t,T). Furthermore, for any n G V, 


,7r,l 

i,T ’ 




on [[t,r^]], P-a.s., 
V=L-i}> on[[r-,r]], P-a.s. 


Then, since {r'" = tj-i} G Pt,,_ 2 ,ti -2 from (14.201) we get 

Ete(x5;"'“‘<”>’”)|J',< C/ 2 (r”,xy’“‘'”>-”) + i P-a.s. 

O 

Taking expectation on both side we have 

J2{t,x,Q^{v),v) < E[U2 {t",xI’^’°‘ + |. 

rt,X,a'‘{v),V _ j^t,X,U,V 


Since Xc 


and the coefficient / is bounded, for p := |7r| >0, we have 


E[ sup \X^ 

0<r<p 


(S«+r)AT E^^+PatI] - ^P- 


Moreover, since U 2 {s,x) is Lipschitz in x, and S" <t'" < S" + p, then we have 

P[|P2(r^x‘f’“'^^^’’') - P2(r^X*“)|] <Cp<l. 

0 


From (I4.24P and (j4.25|) . we have 


Now we denote 




^t,X,U,V\ 


(4.21) 


(4.22) 


(4.23) 


(4.24) 


(4.25) 



(4.26) 

)-eo|, 

(4.27) 
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and from (14.181) . we have P{0.i) > 1 — eo. Thus, from (|4.26l) . (|4.27l) and (14.191) . we have 
J2{t,x,a‘^{v),v) 

N N 


i=k-\-l i=k-\-l 

N N 

< i^[(i^b2(XT)|-Fi,_„t,_J + 6o)-v=t,_,}-ioJ+ CP{n^n{T^ = u.i}) + 

i=k+l i=k+l 

N 


< E[g 2 {XT)] +eo+ Y1 + | < ^2 + (2 + NC)eo + | = es + |, 

i=k+l 


(4.28) 


where X, := X*’^’'^’^. Then from (14.28^ and (j4.2ip we obtain 

Vn G PtT^ J 2 {t,x,a^{v),v) < 62 + ^, and a^(n) = u. (4.29) 

Similarly, we can construct /3^ G B\{t,T) such that 

Vu Ji{t,x,u, I3^{u)) < ei + -, and /3'^(u) = v. (4.30) 

From (|4.29p . (|4.30p and (14.191) . we have, for m = 1, 2, respectively, 

j /3 ) G-m \ — X , U, v') Gm | ^ ~, (4.31) 

namely, we obtain (14.4p . From (|4.3ip we know, for m = 1,2, respectively, 

Gm < Jm{t,x,a^,/3^) + ^. (4.32) 

From (I4.29h . (I4.30h and (j4.32l) . we have 

J 2 {t,x,a’'{v),v) < 62 + I < J2(t,x,a%/3^) + e, 

Ji(t, x, u, P^iu)) < 61 + I < Ji{t, X, a^ /?^) + e. 


From Lemma l4.11 we know (j4.3p holds. 


NGCGSsary condition. 

We assume there exists a NEP (6i, 62) G at the position (t, x), i.e., for any e > 0 , there exists 
6 ^ small enough satisfying that for any partition 7 r = {0 = to < ••• < tN = T} with |7r| < and 
t = tk-i, there exists G Ai{t,T) x be such that for any (u,v) G x the 

following inequalities hold: 

2 2 

Ji{t,x,a^,P^) > Ji{t,x,u, P^{u)) - y and J2(t, x, 0% /3^) > J2(t, x, W(n), n) - y, (4.33) 
and for m = 1, 2, respectively, 

e2 

I Jm(t,x,Q:%/3'') - 6m| < y. (4.34) 
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From Remark l2.ll we know there exist G x such that q;^(u^) = u'^, /3'^{u'^) = v'^. 

Now we see (j4.9h holds obviously. We suppose (|4.8jl doesn’t hold, then we assume that there is 
some j G {k,..., A^}, without loss of generality, we consider the case m = 1 such that 


Define 




jTtA 


(4.35) 


(4.36) 


From Lemma [41^ 61. let u' := G > then there exist a strategy a G AJ{t, T) such that, for any 


V G a{v) = on [t, P-a.s., and 




(4.37) 


For {a,/3‘^) G Aj{t,T) x B1{t,T), there exists a pair (u,u) G x such that a{v) = u, 

/3'^(ri) = V. Notice that u = u^,v = v^, on [t,tj-i]. Define u by setting: 


u = 


^ on X D) U {[tj-i,T] X A^), 

, on [tj_i, T] X A. 


Obviously, u gU 


t,T- 


And we know /3'^(«) = on [t, tj_i), and for s G f3'^{u)s = < 

L SI 


Vs, on A, 
on A'’. 


rt,X,U,P^{u) 


■^s , 


X. 




Then, we have on [t, tj-i]. For s G [tj-i, T], W 

Furthermore, we have 

Ji(t,x,n,/3^(F)) = • I^c] + F;[ 5 i(X^"’“(")’") • /a] 

= • Ia^] + E[i7[5i(X^"’“(")’")|• /a] 

> • Ia^] + • /a] - |P(A) (from g3Zl)) 

> i7bi(X^"’“'’"')] + ip(A) (from (0321)) 


on A, 
on A'^. 


> Ji(t, X, /S*^) + —, (from (14.351) and (14.361) 1 


which is in contradiction with 0.33p . Therefore, (14.8p holds. 


(4.38) 

□ 


To prove Theorem 14.21 we only need to prove that for any e > 0, there exists small enough 
satisfying that for any partition vr = {0 = to < D < • • • < = 7"} with |7r| < and t = t^-i, 

there is a pair (u^, v^) satisfying the conditions of Theorem 14.11 For this we show a stronger result. 

Proposition 4.1. For any e > 0, there exists 5^ small enough satisfying that for any partition 
t: = {0 = to < h < ■ ■ ■ < tN = T} with |7r| < 6^ and t = tk-i, there exist a pair G xV^’^, 

such that, for any k < i < I < N, and m = 1,2, respectively. 


E[Um{ti, Xt,)\Xtk_2,ti.2] > Umiti-i,Xt,_^) - e, P-a.s., 


(4.39) 


where X = 
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Remark 4.1. If Proposition 1^.11 holds, then we set I = N, we have Um{T,x) = gm{x), i-e., 
Um{T, '^ ) = ), then we know the pair satisfy the conditions of Theorem 

\4-l\ let e —>■ 0, we obtain the NEP (ei, 62 ). 


We first give the following lemma. 

Lemma 4.3. For any e > 0, there exists 6^ small enough satisfying that for any partition vr = {0 = 
to < ti < ■ ■ ■ < tM = T} with |7r| < 5^ and t = tk-i, there exists a pair {u'^,v'^) E x V^’^, such 
that, for m = 1,2, respectively, 

( 4 , > U^{t, x) - e. (4.40) 


Proof. Prom the definition of Ui{t,x) and U 2 (t,x) (refer to (14.6h and (I4.7p l. there is some 6^ such 
that when |7r| < 5^ 


Ui{t,x) 


lim sup inf Ji(t,x,a, (I) < 
kK0ae44t,r) h&Bi(t,T) 


sup inf Ji{t,x,a, (5 )-\—, 


U 2 {t,x) = lim sup inf J 2 {t,x,a, fl) < sup inf J 2 {t,x,a, jl) +-. 

kK0/3GB4t,T) “e44t,r) /3eBf0,T) «e47(t,r) 4 

Then we choose a!" E Af{t,T) and E Bf{t,T) such that 

Ui{t,x) < inf Ji(t,x,a'',l3) + ^< inf Ji(t,x,W(u),u) + 

2 2 

e ’ e (4.41) 

U 2 {t,x) < inf J 2 {t,x,a, (3'^) -\—< inf J 2 {t,x,u,/3'^{u ))-\—. 


aeAJ{t,T) 


new, 


7r,l 

t,T 


For from Remark [2.II there exists a unique pair {u^, v^) such that, a’^{v’^) = u'^, /3'^(u'^) = v’^. 

Now we want to prove that (u^,v^) satisfy (14.401) . For this, we suppose (I4.40p doesn’t hold, i.e., for 
m = 2 (m = 1, similar) such that 


E[U2ih,Xlf’^‘n]<U2it,x)-e. 


(4.42) 


From Lemma l4.2l al. for u' := there exists a NAD strategy a E Af{t,T), for any v E such 
that a{v) = u^, P-a.s., on [t,4], and 

< 7 / 2 ( 4 ,P-a.s. (4.43) 

From Remark |2. II we know there exists a couple {u, v) E x such that, a{v) = u, /3'^{u) = v. 

Dince u — u ,v — v , on [r,4J, we know Xf^ = X^^ = Xf^ , P-a.s. 

From (I4.43P and (j4.42p . it follows that 


J2{t,x,u,l3^{u)) = J 2 {t,x,a{v),v) = E[E\g2{xtff’°'^'’'^''’)\Et^_.^^tk-i]] 
<F;[[/2(4,+ I < U 2 {t,x) - 

which is contradictory to (I4.4ip . Hence, ()4.40p holds. 


(4.44) 

□ 


We now give the proof of Proposition 14.11 
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Proof. Firstly, we show that when I = i, Proposition 14.11 holds. 

Similar to Lemma 14.31 we know for any e > 0, there exists 6^ small enough satisfying that for any 
partition -it = {0 = to < ti < ■ ■ ■ < = T} with |7r| < 6^ and t = for any y there exist 

(uj Vj’^) G ^ J = ^ ~ 1) • • • 5 ~ 1) such that for m = 1, 2, respectively, 




3 


(4.45) 


For the partition tt with |7r| < 6^, we now give the construction of (u^, v^) G ^ ^tT induction 
on [ti-i,ti) satisfying, for i = A;,..., A^, 


- 6, p-a.s.. 


t,X,U^,V^ 


(4.46) 


For i = k, from (j4.45p we know there is satisfying (I4.46p . We define u^\[t^._i,tk) ■— 

-Cl- 

For i = k + 1, from (j4.45p we know for any y G M”, there is {ujf G ^ such that, 
for m = 1, 2, respectively. 


i?[t/^(4+i,<^;C"’"")] ^ Umitk.y) - 


(4.47) 


Since the coefficient / is bounded, there is some 72 > 0 such that ’’^ | < 72. Then there 

exists a finite Borel partition of Bii{0). From ()4.47p . we have for any z G Oi, there is some 

yi G Oi, such that 

€,yi e,yi 

7;[7/^(4+i,C;C )]>Umitk,z)-e. (4.48) 

n n 

Now we define := E 

I — 1 I — 1 

(14.481) we have 




1=1 

n 

^ z) = f7m(Afc)77j^ ) €, P-H.S 


IWfc eOi} 


(4.49) 


> 


1=1 


Repeating the above step, we can get (u^,u^) G x satisfying p4.46p . 
Next for I > i, from (14.461) with using e := -^ we get 


E[Urn{U,Xlf’-^’^^)\E,,_,,^_,]=E[E[U^{U,Xl^^^^^^ 


□ 


5 Characterization for the functions W{t,x,p,q) and V{t,x,p,q) 

This section mainly gives a characterization for W{t, x,p, q) and V{t, x,p, q). Under some equivalent 
Isaacs condition, we prove that W(t,x,p,q) = V{t,x,p,q). This characterization guarantees that 
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we can consider the discrete case (with the strategies along the partition vr) for some indiscrete zero- 
sum differential games with asymmetric information. With this property, we provide a new method 
to calculate the value of the zero-sum differential games through considering all the partitions. 

For simplicity, we only consider the case that Player I and II have no private information in a 
small time from beginning, then they observe each other and only know the opponent’s probability, 
i.e., along with the partition vr = {0 = to < < • • • < = T}, < t < tk, the strategy 

a : Q X [t,T] X Vt,T ^t,T of Player I has the following form 


N 


a{uj,v){s) — akiv){s)I^t,tk)i^) + “K(Cpfc) Cgfc+i) ■ ■ ■ > Cp/-i )(‘^))s e [t,T], 


where : [t,tk) x Vt,T Ut,T-, ai : ^ x [ti_i,ti) x Vt,T i-t k + 1 < I < N, are Bor el 

measurable functions satisfying: For all v,v' E Vt,T, it holds that, whenever v = v' a.e. on [t,t;_i], 
we have for all x E ai{x, v)(s) = ai(x, v')(s), a.e. on k + 1 < I < N. 

Obviously, the strategy a such defined is a special case of Definition 12.11 still denoted by A^{t, T) for 
the set of the strategy a that have the above form. Similarly, we have the definition for the strategy 
P and for the set we still denoted by Obviously, for tt' C tt, we have A^'{t,T) C A'^{t,T). 

A{t,T) and B{t,T) are the union of A^{t,T) and B'^{t,T) with all partition vr, respectively. It 
is noticed that the strategies used in this section have the above forms, the rest corresponding 
definitions are the same with that defined in Section 2. 

To give the characterization, we introduce the following upper and lower value functions as 
follows 


W'^{t,x,p,q) 

V^{t,x,p,q) 

W'^{t,x,p,q) 

V^{t,x,p,q) 


inf sup J(t,x,a, 

ae{A'^(t,T)Y p^{js{t,T)y 

sup inf J{t,x,a, P,p,q), 

p&{B{t,T)y Y,T)y 

inf sup J{t,x,a, P,p,q), 

a&(A{t,T)y (t^T)y 

sup inf J(t,x,a, B,p,q). 

ayA{t,T)y 


(5.1) 

(5.2) 

(5.3) 

(5.4) 


Next we first prove (W^{t,x,p,q),V'^{t,x,p,q)) and {W^{t,x,p,q),V'^(t,x,p,q)) converge uni¬ 
formly on compacts to the same couple {U{t,x,p,q),U{t,x,p,q)), as |7r| ^ 0, under the condition 


inf sup f{x,u,i')A= sup ini f{x,u,i') Aj (5-5) 

uep(v) 


• ? = inf sup/(x,Ai,'(;) • C, (5.6) 

v&V k'&'PiU) v&V 

respectively, where /(x, p, v) := jjj f{x, u, v)p{du), f{x, u, u) := fy f(x, u, v)u{dv), and the function 
U{t,x,p,q) is the unique solution of the HJI equation (j8.53j) . Then we show that the functions 
W{t, x,p, q) = U{t, x,p, q) = V{t, x,p, q) under the conditions (|5.5p and (j5.6l) . 

Remark 5.1. The assumptions (j5.5jl and (j5.6p hold, if and only if the following classical Isaacs 
condition holds: 

inf sup f{x, u,v) ■ = sup inf /(x, u, v) ■ f,. (5.7) 

u&U y^yueU 
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Indeed, we have 


ini f{x,n,v)-^= inf / f {x,u,v) ■ Cdn{u) > inf f{x,u,v) ■ ^ > inf f{x, n,v) ■ 

V&T’iU) V&V(U) Ju ueu V&'PiU) 

hence, inf f {x, fj,,v) ■ ^ = ini f{x,u,v) ■ Similarly, sup f {x,u,u) ■ ^ = sup f{x,u,v) ■ 
n&'Piu) u&u v&v{v) vgv 

If (|5.5p and (I5.6p hold, then we have 

inf sup/(x, w, i;)-^ = inf sup f{x,u,iy)-^= sup inf/(x, it, i^) • ^ = sup inf f{x,^,v)-^. 

u&U y^y u&U v^-plv) v&vlv) v&V{V) V&'PiU) 

sup inf/(x,?x,x)-^ = sup inf /(x,^,x)-C= inf sup/(x,//,x) • ^ = inf sup f{x,n,u)-^. 

yfzyueu y^V/l&PiU) fieViU)y(ZV ^l&V(U) 

Then, we get classical Isaacs condition (ILZP holds. 

If mi holds, then we have 

inf sup /(x, u,v) ■ = inf sup /(x, u,v) ■ ^ = sup inf /(x, u,v) ■ ^ = sup inf /(x, u, v) ■ 

U&U ueu y^Y y^yueU 

then we know (I53|) holds. Similarly, we get (IMI). 

Similar to the proof of Theorem 1 3.2 p we get the following result. 

Theorem 5.1. The functions (V^^) and (W^") converge uniformly on compacts to a same Lips- 
chitz continuous function U when the mesh of the partition iTn tends to 0. Moreover, the function 
U is the unique dual viscosity solution of the HJI equation ()3.53l) . 

Now we only prove the convergence of {W'"{t,x,p,q),V'"{t,x,p,q)) and the proof of {W'^ 
{t,x,p,q),V'^{t,x,p,q)) is similar. 

Notice that for any fixed f5 G B(t,T), there exists some partition vr such that /? G B^{t,T). 
Using this technique and the method which have been used in Section 3, we have the following 
lemmas. 

Lemma 5.1. The functions W'^ and V'^ are Lipschitz continuous with respect to {t,x,p,q), uni¬ 
formly with respect to vr. 

Lemma 5.2. For any {t,x) G [0,T] x M”, the functions W'^{t, x,p, q) and V'^{t,x,p,q) are convex 
in p and concave in q on A(/) x A{J), respectively. 

Lemma 5.3. For all {t,x,p,q) G [0,T] x M"" x x A(J), we have 

./ 

V^*{t,x,p,q) = inf sup max {pi -'^qjE[gij{x!f'’°‘’^^)]}. (5.8) 

Proof. Define Vp*{t, x,p, q) = inf(^.)g(g(j ,r))j sup„g_ 4 j( 4 ^r) )]}• 

Similar to the proof of Lemma 13.41 we have 


V^* {t,x,p,q) = inf sup max {pi— 

a&A'-yT) 


.7 

E 

j=i 


qjE[9'. 


ij 


)]}• 


(5.9) 
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Since C T), we have *(t, x,p, < V'^*{t,x,p,q). Now we prove the x,p, g) > 

V'^*{t,x,p,q). For any a G A^{t,T) , for any y = {yi,y 2 , ■■■,y 2 (N-k)-i) G it holds 

a{y,-) G ^Q(t, T). For any {/3j) G {B{t,T)Y, we have the following inequalities 


sup max {pi - ^ qjE[gij{xtY '''''^')]} 


< sup 


max 


aeA'^(t,T) J[o,i]2(^-'=)-i *e{i,...,/} 


r— \ ^ T-ir /5?/2 )■ ■ ■ )y2(W —fc) —l) \ 1 -i 7 i 

{Pi - Z^qjE[gij{Xj. )\}dyi...dy2{N-k)-i 


i=i 

j 


(5.10) 


< sup sup max fa — qjE[gij{X, 


t,x,a{{yi,y2,...,y2{N-k)-l),-)Pjy^^ 


J 

< sup max {pi-'^qjE[gij{xY’'^'^Y]}- 


Then taking infimum over (/3j) G {B{t,T)Y on both side we get the desired result. □ 

Lemma 5.4. For all the partition tt ofthe interval [0,T], the convex conjugate function V'^*{t,x,p,q) 
is Lipschitz with respect to {t, x, p, q), the concave conjugate function W'^^{t, x, p, q) is Lipschitz with 
respect to {t, x,p, q). 

Lemma 5.5. For any {t,x,p,q) G [tk-i,tk) x M” x x A(J), and for all I {k < I < N), we have 


V'^*{t,x,p,q)< ini sup g)] 

l 3 €:B{tYi) a£AQ{tYi) 

ElV^Yti^XlY’^^’Yp^q)]. 


(5.11) 


For the proof of this lemma, we give the following remarks. 

Remark 5.2. The proof of the first inequality is similar to Lemma \3.(^ with the help of Lemma 
no and one should be notieed that a G AQ{t,ti) means a is a deterministic strategy. The second 
inequality is obviously since AQ{t,ti) C A^{t,ti). 

Lemma 5.6. There exists a subsequence of partitions (vr„)„>i, still denoted by (vr„)n>i; o-'iT'd two 
funetions V : [0,r] x M"' x x A(J) i—;■ R and W : [0, T] x R" x A(/) x R*^ i-G R such that 
(^yiTn*^ [V,W) unifocmly on compacts in [0,T]xR”'xA(/)x A(J)xR^xR‘^. Furthermore, 
the functions V and W are Lipschitz continuous with respect to all their variables. 

Lemma 5.7. The limit function V{t,x,p,q) is a viscosity subsolution ofthe same FIJI equation 

(1081) . 

Notice that 


I ,/ 

-W'^{t,x,p,q) = sup inf V (5.12) 

{ap&(AHt,T)y ihj)&mT)y 

Hence, the convex conjugate of {—W"") with respect to g, i.e., — (lT’^^(t, x,p, —g)) satisfying a 
sub-dynamic programming principle. Then, we have the following lemma. 
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Lemma 5.8. For any {t,x,p,q) E [tk-i,tk) x M"" x A(/) x and for all I {k <l < N), we have 


W^*{t,x,p,q) > sup inf E[W'^*{ti,Xlf'°‘'^,p,q)] 

aSA'^ 


(5.13) 


Proposition 5.1. The limit function W{t,x,p,q) is a viscosity supersolution of the same HJI 
equation iS.SSfl under the condition (15.51) . 


Proof. For simplicity, we denote W{t,x,p,q) by W{t,x), for fixed {p,q) E A(/) x For any 
fixed {t,x) E [0,r] x M", since the coefficient / is bounded, there is some M > 0 such that, 
Bm{x) D (s, y) E [0, T] x Bi{x), (a, /3) E A""{s, T) x B{s, T),r E [s, T]}, where Bm{x) is 

the closed ball with the center x and the radius M. From Lemma 15.61 we know converge to 

W over [0, T] x Bm{x). Let p E C^([0,r] x M") be a test function such that 

{-W - (-(p))(t,x) > {-W - {-(f)){s,y), for all {s,y) E [0,r] x Bm{x) \ {(t,x)}. (5.14) 


Let {sn,Xn) E [0,r] X Bm{x) be the maximum point of —— {—p) over [0,r] x Bm{x), then 
there exists a subsequence of {sn, Xn) still denoted by {sn., Xn), such that {sn, Xn) converges to (t, x). 

Indeed, since [0, T] x Bm{x) is a compact set, there exists a subsequence {sn,Xn) and {s,x) E 
[0, T] x.BM(a;) such that (s„, x,i) ^ (s, x). T)\ieio — {—ip)){smXn) > {—W'^^^ — {—ip)){t.,x), 

for n > 1, we have 

{-W - {-p)){s, x) > {-W - i-(p)){t, x). (5.15) 

From (15.140 and (j5.15l) . we have (s,x) = (t,x). 

For the partition 7r„, we assume t^^_^ < Sn < for simplicity, we write t'^_^ < Sn < Since 
Xn X, there is a positive integer N such that for all n > N, we have \xn — x| < 1. Then from 
Lemma [SSI we get 


sup 


-(p{Sn,Xn) = -W'^^*{Sn,Xn) < inf 

< inf sup 


(5.16) 


Thus we get 


0< inf sup - (-V9(Sn,Xn))] 

Bk Bud 

inf sup E[- (^(r,A*-^-“’^) + /(A,^"’^"’"’^,a„/l,) •L>(/p(r,A,^"’^"’"’^))dr]. 

I3(zrs(sn,ti) Jsr, 9r 

For (u, v) E Ut^T X Vt,T, we introduce the following continuity modulus, 
m{6) := 


d d 

|(l^(Fy) + f{y,u,v) ■ Dp{r,y)) - {^{s,x) + f{x,u,v) ■ Dip{s,x))\. 

|r - s| + jy - xj < 5, t)r 

u € U, V € V, X, y G (x) 

(5.18) 

Obviously, m{S) is nondecreasing in 6 and m{6) —0, as (i | 0. From (12.2p . considering that 


I A, 


s„,Xn,a,l3 


— Xn\ < C\r — Sn| < Clf^ — Sn|, X E [snAk] from (I5.18p we know that 

|(^(r, + f{Xr"’''"'°‘’^,ar,Pr) • L>(/?(r, Ar"’^"’“’^))- 

(■^(SnjXj^) T /(X)T,, Ofj.,/^r) ' T)tp(^Sm Xn))\ ^ Xn(^C\tf. Sj^j), r E [Snjt/j]' 


(5.19) 
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It follows from (j5.17l) and (I5.19P that 


- (tl -Sn){- ^{Sn,Xn) + m{C\tk - S„l)) 


< 


sup E[ {-f){Xn,ar, i^r) * Eipi^Sfi^ x^)(ir] 
Jsr, 

ftk 

sup E[ {-f){Xn,ar,Pr) ■ D(p{Sn,Xn)dr], 

P&B(Sn,K) J Sr, 


< inf 

rt' 


(5.20) 


where we take = Uk, r £ £ U. Define pn = — Sn)^; then from (I5.20p there exists a 

Pn-optimal strategy Z?” G B{sn,t'^) (depending on d^) such that 

-{tk-Sn){-^iSn,Xn)+m{C\tl-Sn\) + itl-Sn)) < E[ f (-/)(x^, d,-,/3)?)•D(/?(Sn, Xn)dr]. (5.21) 

t/ Sji 

Since /?"■ G ^(s^, t^) there is some partition such that (3"' G {sn, t^), without loss of generality, 
vr® D 7r„. Assume = Oq < di < ... < 9^ = C vr®. Therefore, 

/■ife ™ rOi 

E[ {-f){Xn,ar,P^) ■ Dp{Sn,Xn)dr] E[{-f){Xn, Ur, ■ Dip{Sn, Xn)]dr, (5.22) 

J Sn / = 1 —1 

where /3^ depends on (CJ,!) • • • > CJ°-i) [di-i-, 9i\. Then for r G [0;_i, 0/], we have, 

^[(-/)(a^n, ■ Dip{Sn, X^)] = E[{-f){Xn, Ufc, /3^(C2,1: ■ ■ • > C^-l)) ' Dip{Sn,Xn)\ 

= / i-f)iXn,Uk,v) ■ D(p{Sn,Xn)Pnpf.r.O Mv) < SUp / (-/) (x^, Ufc, t’) ' -^(/^(s^, Xn)z^(dn). 

Jy ir^p(y)Jv 

(5.23) 

W e define/(ttfc) := sup^^g-p^y) Jy (—/)(x„, ttfc, x) • D<^(sn, Xn)y(dn), from the arbitrariness of ftfc, we 
can choose Ufc := n*, such that I{u*) = min I{uk)- Then, for all u £ U, from (I5.23p . we have 

Uk&U 

rdl rOi r-Oi r 

/ I{uk)dr = / I{u*)dr < / sup / {-f){xn,u,v) ■ D(p{sn,Xn)di'{v)dr. (5.24) 

Jei_i Jei_i u&v(v) Jv 


From P5.24I) and the condition (15.5p we obtain 
I{uk)dr <{01 - 9i_i) inf 

y&V(V) ■ 


[ I{uk)dr <{9i - ei_i) inf sup [ {-f){xn,u,v) ■ Dip{sn-,Xn)dv{v) 
Je,, 


={9i-6i_i) sup inf / {-f){Xn,U,v) ■ Dp{Sn,Xn)du{v) 
ueP{V) Jy 

= {9l-9l-l) sup inf / {-f){Xn,U,v) ■ D(p{sn,Xn)dp{u)du{v). 

usvlv) k-^'PiUjJuxy 

From P5.21I) . ^5.221) . p5.23l) and (I5.25F we have 

— {tk — Sn){ — -^{Sn, Xn) + — Sn|) + (t^ — Sn)) 

<itk-Sn) sup inf / {-f){Xn,U,v) ■ Dip{Sn,Xn)p{du)lx{dv). 

ueplv) ^^^'PiU)Juxv 


(5.25) 


(5.26) 
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Then we have 


^iSn,Xn)-m{C\tl-Sn\)-itk-Sn)) < SUp inf [ {-f){Xn, U, v) ■ Dip{Sn, Xn) fJ-idu)l'{dv). 

Or veplv)i^^'PdJ) Juy^Y 

(5.27) 

Recall that {sn, Xn) (t, x) and 0 < — Sn) < < \'Xn\-, when n ^ oo we get 

inf sup f f{x,u,v)-Dip{t,x)fj,{du)iy{dv)<0. (5.28) 

Ot i^&'PiV) Juxv 

Therefore, W{t,x,p,q) is a viscosity supersolution of the HJI equation (|3.38l) . □ 

Similar to Section 3 (Proposition 13. ll and Theorem 13.2p . we have the following results. 

Proposition 5.2. If condition / [5.5|) holds, then for all sequences of partitions (iTn) of the interval 
[0,T] with |7r„| —)■ 0, as n ^ oo, there exists a subsequence of partitions, still denoted by {'nn)n>i 
such that and converges uniformly on eompaets to a eouple {U,U), and the function 

U is the unique dual solution of the HJI equation (j3.53p . 

Theorem 5.2. Suppose condition US. 5]) holds, then for all sequences of partitions (vr^) with |7r„| ^ 

0, the sequences (P^") and converge uniformly on compacts to the same Lipschitz continuous 

function U. Moreover, the function U is the unique dual solution of the HJI equation (I3.53p . 

Similar to we obtain the following theorem. 

Theorem 5.3. Suppose condition US. 6\} holds, then for all sequences of partitions {iTn) with |7r„| —)• 

0, the sequences (P^^) and (fP’^") converge uniformly on compacts to the same Lipschitz continuous 
function U. Moreover, the function U is the unique dual solution of the HJI equation (j3.53p . 

Now from Theorem EH Theorem 15.21 and Theorem 15.31 we get the following result. 

Theorem 5.4. Under the conditions (15. 5p and ()5.6p . the function W{t,x,p,q) is equaltoV{t,x,p,q), 
for all compacts in [0,T] x M” x A(/) x A(J). 

Proof. We have shown that the value functions W'"{t, x,p, q), V'^{t, x,p, q), W^{t, x,p, q), V^{t, x,p, q), 
W'"{t, x,p, q), V'^{t, x,p, q) converges uniformly on compacts to the function U{t, x,p, q), as |7r| —)■ 0, 
under the assumptions (15.51) and (|5.5p . where the function U(t, x,p, q) is the unique solution of the 
HJI equation (|3.53l) . 

Then, from the definition of W{t,x,p,q), for any e > 0, there exist G {A{t,T))^, such that 
e+ W{t,x,p,q) > sup J{t,x,6J, fi,p,q). (5.29) 

For G {A(t,T)y, there exist a partition such that G (A'^'^(t,T))^ C {A^{t,T)y, for 
TT D TT^. Thus for all vr D tt^, it holds that 

e+ W{t,x,p,q) > sup J{t,x,y, P,p,q) > W^{t,x,p,q). (5.30) 

From the arbitrariness of e, we have W{t,x,p,q) > W'^{t,x,p,q), then let |7r| ^ 0, we have 

W{t,x,p,q) >U{t,x,p,q). (5.31) 
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Similarly, we have 


U{t,x,p,q) > V{t,x,p,q). 


(5.32) 


On the other hand, since W{t,x,p,q) < inf sup J{t,x,a, $,p,q) = W'^{t,x,p,q), 

aeiA-^{t,T)y p^{js{t^T)y 

let |7r| —)• 0, we have 

W{t,x,p,q) <U{t,x,p,q). (5.33) 

Similarly, since V(t,x,p,q) > V'^(t,x,p,q), let |7r| —>■ 0, we have 


V{t,x,p,q) > U{t,x,p,q). 


(5.34) 


Now from (I5.3ip . (|5.32l) . (|5.33l) and (|5.34l) . we get W{t,x,p,q) = U{t,x,p,q) = V{t,x,p,q). □ 


Now we give a example to explain that the conditions (15.5p and (|5.6I) are necessary even for the 
games with symmetric information. 

Example 5.1. We assume U = V = [—1,1], I = J = 1, g{x) = x, f{x,u,v) = \u — v\‘^. For any 
given {t,x) E [0,T] x M”, the dynamic is 

Xs = x + J^ \us-Vs\‘^ds, s£[t,T]. 


The payoffs 

Jit,x,a,/3) = E[ 5 (X^"’“’^)] = 


From B,emark F2ff\. we know there exists the unique {u, v) E x Vt,T, such that a{v) 
then we have 


J{t, X, a, j3) 



— (dr\^dr]. 


u, /3{u) = V, 
(5.35) 


For any x E M, {u,v) £ U xV, p £ W, the Hamiltonian function H{x, u, v,p) = \u — v\‘^p. Moreover, 
we define 

H~^{x,p) = inf sup H{x, u, v,p) = inf (1 + \u\)^p'^ = p"*"; 

u&Uu&U 


H {x,p) = sup inf H{x,u,v,p) = sup ( — (1 + \v\)‘^p ) = —p . 


Obviously, for any p / 0, H~{x,p) = —p~ < p'^ = H^{x,p). For the measure-valued con¬ 
trols jjL £ V{U),v £ Viy) and {x,p) £ the Hamiltonian function H{x, p,n,p) = ffj Jylu — 
v\‘^pv{dv)p{du). We define 


H~^{x,p)= inf sup H{x,p,v,p)] H {x,p) 
u&V{U) ueViV) 


sup inf H{x,p,v,p). 
v&vlv) U&'PiU) 


Then we know H{x,p) := H~^{x,p) = H {x,p). Now we compute H {x,p). For the case p > 0, 
sinee 


H{x,p,i',p)= / / \u — vypiJ,{du)u{dv) 

Jv Ju 



V JU 


(lx— / vv{dv)\'^ + \u— / vi'{dv)\’^)pp{du)v{dv) (5.36) 

Jv Jv 


> j^\v - j^vv{dv)ypv{dv) = H{x,6j^„,,(^a„),v,p), 
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we know = {fv\^ - Therefore, 

H-{x,p) = sup^gp(y )(/^\v - fyvi'{dv)\‘^i'{dv))p = sup^gp(y) (^fyv^i^(dv) - (fyviy(dv})^^p < p, 
and when v = ^{5i + 5_i) it attains the maximum value. 

For the case p < 0, H-{x,p) = - infj,g 7 [,(y) sup^^-pf^u-^ fjj fy lu-vl^p(du)iy(dv)(-p)^ = -(-p)+ = 

p. Thus, we get H{x,p) = H~{x,p) = p. 

The corresponding HJI equation is as follows: 

I yiT,x) = g[x) = x. 

Notice that V{t,x) = x + T — t, t G [0,T],x gM. is the solution of this equation. 

If both players use the same partition n, as |7r| —)• 0, from Theorem \3.2\ we have {W'^{t,x),V'^{t,x)) 
converge to the same function V{t,x). If not, for example, we calculate 


W'^{t,x)= inf sup E[g{X^rf^’°''^)]. 
aeA-^{t,T) p^B{t,T) 

For Player I, we assume the partition -k = {Q = to < ti <■■■< t^ = T}, t G [tk-i,tk), without 
loss of generality, we assume t = o-'iT'd c^r = ctkiCf k-i)r> ^ ^ 

For Player II, we consider the partition = {0 = {to =)So < Si < ... < S 2 ’^{= ti) < S' 2 " +1 < 

• • • < 5'2"+2"(= t 2 ) < ... < S'(i_i) 2 "+j < ... < 5 '(jv-i)2’>+2'i(= ^n) = T}, where S'(;_i) 2 ’j+j = + 

j{ti-ti_i)2~^, 0 < j <2"-, 1 <l < N. On the subinterval aI^ := [S'(i_i) 2 n+m-i, 5'(z-i)2’>+m]? Player 
II uses the strategy Pr = /35(i_i)2n+^(Q/_i)2-+m-i ’I < m < 2^, k < I < N. 
Obviously, f3r{u) = satisfy the above situation. 

Now let Pr{u) — in y ^ and from the equation i5.S5\) . we get 


J{t, x,a,fl) = x + 


rt+\Trn\ rT 

E[\ar\‘^]dr + E[ \ar + sgn(a,._jr„)|^(ir] 

; Jt+\-Kn\ 


rT j-T 

= X + E[ \ar + sgn{ar)\'^dr] + Rn = X + E[ {1 + \ar\)'^dr] + Rn, 

Jt Jt 


(5.38) 


where Rn = E[\ar\'^]dr- E[\ar + sgn{ar-\Tr^\)\'^]dr + E[J^{\ar + sgn{ar-\Tr^\)\‘^ - \ar + 

sgn(Q;,.)P)dr] < |7r„| + 4|7r„| + ‘iE[J^ \ sgn(Q;r) — sgn(a^_|jr„|)|fir]. Now we give the following lemma 
to explain R^ —>-0, as n ^ 0. 

Lemma 5.9. For all u G L^([0,T]), it holds lim^^o — Ug-el^ds = 0. 


Proof. For any fixed u G L^([0,T]), since (^^([OjT]) is dense in L^([0,T]), for all p > 0, there exists 
uP G (^^([OjT]), such that (f^ |rts — Ua\’^ds)^ < p. Then, we have 

(f^ — Us-epfis) 2 < Cp + C(f^ \us — as_£pds )2 < Cp + CeVt 0, when e and p ^ 0. □ 


From this lemma we know that when n 00 , Rn —)• 0. Thus, from our choice of (3 G B'^"{t,T) 
and the equation 115.38\} we have 


fT 

J{t,x,a, P) = X + E[ {1 + \ar\)‘^dr] + Rn, and Rn ^ 0, as n ^ 00 . 


(5.39) 
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On the other hand, for any (3 G B{t,T) = {t,T), we have 

j-T nT 

J{t,x,a,/3) = X + E[J \ar — (3r\‘^dr] < X + E[J {1 + \ar\)‘^dr]. 

From I15.3M and we have J{t,x,a, f3) = x + E[J^{1 + la^D^dr]. Then 

W'^{t,x) = inf sup E[g{x!ff'°‘’^)] = X + {T — t) = V{t,x). 




(5.40) 


(5.41) 


We assume n and vr^, as before, choose = 

r*+kr>| \o |2 -7-1 . 7-.r rT 


[f,t + |7r„|]; 


, then we have J(t, x, a, ft) = 


f^r—\Trn\^ 4“ I ’^n1 7 2"'] , 

X + |/3rp(ir] + I |/3r — Pr-nnl'^dr], when n oo, from Lemma [JTPi we have 


inf E[g{Xhf’^'^)] = x. 
a&A(t,T) ^ 


Then, we know 

V'^(t,x)= sup inf E[g{Xj,^''^’^)] = X. (5-4:2) 

/3eB^{t,T) aeA{t,T) 

Using the same argument we have 

W{t, x) = inf sup E[g{Xhf'°^'^)] = x + {T — t)\ 

o^&A{t,T) 

n (5.43) 

V{t,x)= sup inf E[g{x!f^’°‘’^)] = X. 

/3&B(t,T) a&MhT) 


Obviously, the upper value function W(t,x) is not equal to the lower value function V{t,x) if we 
do not consider the conditions (ESP and (E3)- 
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